Aug 09 20:36:42 user nova-compute[72620]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 09 20:36:45 user nova-compute[72620]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72620) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 20:36:45 user nova-compute[72620]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72620) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 20:36:45 user nova-compute[72620]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72620) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 09 20:36:45 user nova-compute[72620]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 09 20:36:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:36:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:36:45 user nova-compute[72620]: INFO nova.virt.driver [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 09 20:36:46 user nova-compute[72620]: INFO nova.compute.provider_config [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Acquiring lock "singleton_lock" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Acquired lock "singleton_lock" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Releasing lock "singleton_lock" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Full set of CONF: {{(pid=72620) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ******************************************************************************** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Configuration options gathered from: {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ================================================================================ {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] allow_resize_to_same_host      = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] arq_binding_timeout            = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] backdoor_port                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] backdoor_socket                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] block_device_allocate_retries  = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] block_device_allocate_retries_interval = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cert                           = self.pem {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute_monitors               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] config_dir                     = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] config_drive_format            = iso9660 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] config_source                  = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] console_host                   = user {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] control_exchange               = nova {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cpu_allocation_ratio           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] daemon                         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] debug                          = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] default_access_ip_network_name = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] default_availability_zone      = nova {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] default_ephemeral_format       = ext4 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] default_schedule_zone          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] disk_allocation_ratio          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] enable_new_services            = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] enabled_ssl_apis               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] flat_injected                  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] force_config_drive             = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] force_raw_images               = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] graceful_shutdown_timeout      = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] heal_instance_info_cache_interval = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] host                           = user {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_build_timeout         = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_delete_interval       = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_name_template         = instance-%08x {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_usage_audit           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_usage_audit_period    = month {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] internal_service_availability_zone = internal {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] key                            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] live_migration_retry_count     = 30 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_config_append              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_dir                        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_file                       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_options                    = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_rotate_interval            = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_rotate_interval_type       = days {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] log_rotation_type              = none {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] long_rpc_timeout               = 1800 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_concurrent_builds          = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_concurrent_live_migrations = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_concurrent_snapshots       = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_local_block_devices        = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_logfile_count              = 30 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] max_logfile_size_mb            = 200 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] maximum_instance_delete_attempts = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metadata_listen                = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metadata_listen_port           = 8775 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metadata_workers               = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] migrate_max_retries            = -1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] mkisofs_cmd                    = genisoimage {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] my_ip                          = 10.0.0.210 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] network_allocate_retries       = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] osapi_compute_listen_port      = 8774 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] osapi_compute_unique_server_name_scope =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] osapi_compute_workers          = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] password_length                = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] periodic_enable                = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] periodic_fuzzy_delay           = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] pointer_model                  = ps2mouse {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] preallocate_images             = none {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] publish_errors                 = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] pybasedir                      = /opt/stack/nova {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ram_allocation_ratio           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rate_limit_burst               = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rate_limit_except_level        = CRITICAL {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rate_limit_interval            = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reboot_timeout                 = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reclaim_instance_interval      = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] record                         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reimage_timeout_per_gb         = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] report_interval                = 120 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rescue_timeout                 = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reserved_host_cpus             = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reserved_host_disk_mb          = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reserved_host_memory_mb        = 512 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] reserved_huge_pages            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] resize_confirm_window          = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] resize_fs_using_block_device   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] resume_guests_state_on_host_boot = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rpc_response_timeout           = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] run_external_periodic_tasks    = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] running_deleted_instance_action = reap {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] running_deleted_instance_timeout = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler_instance_sync_interval = 120 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_down_time              = 720 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] servicegroup_driver            = db {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] shelved_offload_time           = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] shelved_poll_interval          = 3600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] shutdown_timeout               = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] source_is_ipv6                 = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ssl_only                       = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] state_path                     = /opt/stack/data/nova {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] sync_power_state_interval      = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] sync_power_state_pool_size     = 1000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] syslog_log_facility            = LOG_USER {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] tempdir                        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] timeout_nbd                    = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] transport_url                  = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] update_resources_interval      = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_cow_images                 = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_eventlog                   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_journal                    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_json                       = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_rootwrap_daemon            = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_stderr                     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] use_syslog                     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vcpu_pin_set                   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plugging_is_fatal          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plugging_timeout           = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] virt_mkfs                      = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] volume_usage_poll_interval     = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] watch_log_file                 = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] web                            = /usr/share/spice-html5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_concurrency.disable_process_locking = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.auth_strategy              = keystone {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.compute_link_prefix        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.dhcp_domain                = novalocal {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.enable_instance_password   = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.glance_link_prefix         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.instance_list_per_project_cells = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.list_records_by_skipping_down_cells = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.local_metadata_per_cell    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.max_limit                  = 1000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.metadata_cache_expiration  = 15 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.neutron_default_tenant_id  = default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.use_forwarded_for          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.use_neutron_default_nets   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_dynamic_targets = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_jsonfile_path   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.backend_argument         = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.config_prefix            = cache.oslo {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.dead_timeout             = 60.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.debug_cache_backend      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.enable_retry_client      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.enable_socket_keepalive  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.enabled                  = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.expiration_time          = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.hashclient_retry_attempts = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_dead_retry      = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_password        =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_sasl_enabled    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.memcache_username        =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.proxies                  = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.retry_attempts           = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.retry_delay              = 0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.socket_keepalive_count   = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.socket_keepalive_idle    = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.socket_keepalive_interval = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.tls_allowed_ciphers      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.tls_cafile               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.tls_certfile             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.tls_enabled              = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cache.tls_keyfile              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.auth_section            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.auth_type               = password {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.cafile                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.certfile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.collect_timing          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.cross_az_attach         = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.debug                   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.endpoint_template       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.http_retries            = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.insecure                = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.keyfile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.os_region_name          = RegionOne {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.split_loggers           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cinder.timeout                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.cpu_dedicated_set      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.cpu_shared_set         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.image_type_exclude_list = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.resource_provider_association_refresh = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.shutdown_retry_interval = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] conductor.workers              = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] console.allowed_origins        = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] console.ssl_ciphers            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] console.ssl_minimum_version    = default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] consoleauth.token_ttl          = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.cafile                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.certfile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.collect_timing          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.connect_retries         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.connect_retry_delay     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.endpoint_override       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.insecure                = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.keyfile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.max_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.min_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.region_name             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.service_name            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.service_type            = accelerator {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.split_loggers           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.status_code_retries     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.timeout                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] cyborg.version                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.backend               = sqlalchemy {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.connection            = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.connection_debug      = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.connection_parameters =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.connection_recycle_time = 3600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.connection_trace      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.db_inc_retry_interval = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.db_max_retries        = 20 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.db_max_retry_interval = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.db_retry_interval     = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.max_overflow          = 50 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.max_pool_size         = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.max_retries           = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.mysql_enable_ndb      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.mysql_wsrep_sync_wait = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.pool_timeout          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.retry_interval        = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.slave_connection      = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] database.sqlite_synchronous    = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.backend           = sqlalchemy {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.connection        = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.connection_debug  = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.connection_parameters =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.connection_recycle_time = 3600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.connection_trace  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.db_inc_retry_interval = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.db_max_retries    = 20 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.db_max_retry_interval = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.db_retry_interval = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.max_overflow      = 50 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.max_pool_size     = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.max_retries       = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.mysql_enable_ndb  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.pool_timeout      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.retry_interval    = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.slave_connection  = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] api_database.sqlite_synchronous = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] devices.enabled_mdev_types     = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ephemeral_storage_encryption.enabled = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.api_servers             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.cafile                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.certfile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.collect_timing          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.connect_retries         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.connect_retry_delay     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.debug                   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.default_trusted_certificate_ids = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.enable_certificate_validation = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.enable_rbd_download     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.endpoint_override       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.insecure                = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.keyfile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.max_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.min_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.num_retries             = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.rbd_ceph_conf           =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.rbd_connect_timeout     = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.rbd_pool                =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.rbd_user                =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.region_name             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.service_name            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.service_type            = image {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.split_loggers           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.status_code_retries     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.timeout                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.verify_glance_signatures = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] glance.version                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] guestfs.debug                  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.config_drive_cdrom      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.config_drive_inject_password = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.enable_remotefx         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.instances_path_share    =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.limit_cpu_features      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.use_multipath_io        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.vswitch_name            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] mks.enabled                    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.manager_interval   = 2400 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.precache_concurrency = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.remove_unused_base_images = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] image_cache.subdirectory_name  = _base {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.api_max_retries         = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.api_retry_interval      = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.auth_section            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.auth_type               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.cafile                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.certfile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.collect_timing          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.connect_retries         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.connect_retry_delay     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.endpoint_override       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.insecure                = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.keyfile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.max_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.min_version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.partition_key           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.peer_list               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.region_name             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.serial_console_state_timeout = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.service_name            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.service_type            = baremetal {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.split_loggers           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.status_code_retries     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.timeout                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ironic.version                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] key_manager.fixed_key          = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.barbican_api_version  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.barbican_endpoint     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.barbican_endpoint_type = public {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.barbican_region_name  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.cafile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.certfile              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.collect_timing        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.insecure              = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.keyfile               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.number_of_retries     = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.retry_delay           = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.send_service_user_token = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.split_loggers         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.timeout               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.verify_ssl            = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican.verify_ssl_path       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.auth_section = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.auth_type = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.cafile   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.certfile = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.collect_timing = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.insecure = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.keyfile  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.split_loggers = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] barbican_service_user.timeout  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.approle_role_id          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.approle_secret_id        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.cafile                   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.certfile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.collect_timing           = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.insecure                 = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.keyfile                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.kv_mountpoint            = secret {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.kv_version               = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.namespace                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.root_token_id            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.split_loggers            = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.ssl_ca_crt_file          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.timeout                  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.use_ssl                  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.cafile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.certfile              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.collect_timing        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.connect_retries       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.connect_retry_delay   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.endpoint_override     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.insecure              = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.keyfile               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.max_version           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.min_version           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.region_name           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.service_name          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.service_type          = identity {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.split_loggers         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.status_code_retries   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.timeout               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] keystone.version               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.connection_uri         =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_mode               = custom {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: WARNING oslo_config.cfg [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_power_governor_high = performance {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_power_management   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.device_detach_attempts = 8 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.device_detach_timeout  = 20 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.disk_cachemodes        = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.disk_prefix            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.enabled_perf_events    = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.file_backed_memory     = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.gid_maps               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.hw_disk_discard        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.hw_machine_type        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_rbd_pool        = rbd {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_type            = default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.images_volume_group    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.inject_key             = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.inject_partition       = -2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.inject_password        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.iscsi_iface            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.iser_use_multipath     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_downtime = 500 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_inbound_addr = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_scheme  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_timeout_action = abort {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_tunnelled = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: WARNING oslo_config.cfg [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 09 20:36:46 user nova-compute[72620]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 09 20:36:46 user nova-compute[72620]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 09 20:36:46 user nova-compute[72620]: and ``live_migration_inbound_addr`` respectively.
Aug 09 20:36:46 user nova-compute[72620]: ).  Its value may be silently ignored in the future.
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.live_migration_with_native_tls = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.max_queues             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.nfs_mount_options      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_pcie_ports         = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.pmem_namespaces        = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.quobyte_client_cfg     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rbd_secret_uuid        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rbd_user               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rescue_image_id        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rescue_kernel_id       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.rx_queue_size          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.smbfs_mount_options    =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.snapshot_compression   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.snapshot_image_format  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.sparse_logical_volumes = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.swtpm_enabled          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.swtpm_group            = tss {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.swtpm_user             = tss {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.sysinfo_serial         = unique {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.tb_cache_size          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.tx_queue_size          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.uid_maps               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.use_virtio_for_bridges = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.virt_type              = kvm {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.volume_clear           = zero {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.volume_clear_size      = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.volume_use_multipath   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_cache_path   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.auth_section           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.auth_type              = password {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.cafile                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.certfile               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.collect_timing         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.connect_retries        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.connect_retry_delay    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.default_floating_pool  = public {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.endpoint_override      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.extension_sync_interval = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.http_retries           = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.insecure               = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.keyfile                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.max_version            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.min_version            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.ovs_bridge             = br-int {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.physnets               = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.region_name            = RegionOne {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.service_metadata_proxy = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.service_name           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.service_type           = network {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.split_loggers          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.status_code_retries    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.timeout                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] neutron.version                = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] notifications.bdms_in_notifications = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] notifications.default_level    = INFO {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] notifications.notification_format = unversioned {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] notifications.notify_on_state_change = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] pci.alias                      = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] pci.device_spec                = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] pci.report_in_placement        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.auth_section         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.auth_type            = password {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.cafile               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.certfile             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.collect_timing       = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.connect_retries      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.connect_retry_delay  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.default_domain_id    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.default_domain_name  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.domain_id            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.domain_name          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.endpoint_override    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.insecure             = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.keyfile              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.max_version          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.min_version          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.password             = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.project_domain_id    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.project_domain_name  = Default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.project_id           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.project_name         = service {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.region_name          = RegionOne {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.service_name         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.service_type         = placement {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.split_loggers        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.status_code_retries  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.system_scope         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.timeout              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.trust_id             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.user_domain_id       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.user_domain_name     = Default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.user_id              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.username             = placement {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] placement.version              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.cores                    = 20 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.count_usage_from_placement = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.injected_file_content_bytes = 10240 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.injected_file_path_length = 255 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.injected_files           = 5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.instances                = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.key_pairs                = 100 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.metadata_items           = 128 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.ram                      = 51200 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.recheck_quota            = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.server_group_members     = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] quota.server_groups            = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rdp.enabled                    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.image_metadata_prefilter = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.max_attempts         = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.max_placement_results = 1000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] scheduler.workers              = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.host_subset_size = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.isolated_hosts = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.isolated_images = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.pci_in_placement = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.track_instance_changes = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metrics.required               = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metrics.weight_multiplier      = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] metrics.weight_setting         = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.enabled         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.port_range      = 10000:20000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] serial_console.serialproxy_port = 6083 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.auth_section      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.auth_type         = password {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.cafile            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.certfile          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.collect_timing    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.insecure          = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.keyfile           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.send_service_user_token = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.split_loggers     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] service_user.timeout           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.agent_enabled            = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.enabled                  = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.html5proxy_port          = 6082 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.image_compression        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.jpeg_compression         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.playback_compression     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.server_listen            = 127.0.0.1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.streaming_mode           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] spice.zlib_compression         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] upgrade_levels.baseapi         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] upgrade_levels.cert            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] upgrade_levels.compute         = auto {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] upgrade_levels.conductor       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] upgrade_levels.scheduler       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.cafile = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.certfile = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.insecure = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vendordata_dynamic_auth.timeout = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.api_retry_count         = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.ca_file                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.cache_prefix            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.cluster_name            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.connection_pool_size    = 10 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.console_delay_seconds   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.datastore_regex         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.host_ip                 = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.host_password           = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.host_port               = 443 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.host_username           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.insecure                = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.integration_bridge      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.maximum_objects         = 100 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.pbm_default_policy      = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.pbm_enabled             = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.pbm_wsdl_location       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.serial_port_proxy_uri   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.serial_port_service_uri = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.task_poll_interval      = 0.5 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.use_linked_clone        = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.vnc_keymap              = en-us {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.vnc_port                = 5900 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vmware.vnc_port_total          = 10000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.auth_schemes               = ['none'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.enabled                    = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.novncproxy_port            = 6080 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.vencrypt_ca_certs          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.vencrypt_client_cert       = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vnc.vencrypt_client_key        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.disable_rootwrap   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.enable_numa_live_migration = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.libvirt_disable_apic = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.client_socket_timeout     = 900 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.default_pool_size         = 1000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.keep_alive                = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.max_header_line           = 16384 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.ssl_ca_file               = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.ssl_cert_file             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.ssl_key_file              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.tcp_keepidle              = 600 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] zvm.ca_file                    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] zvm.cloud_connector_url        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] zvm.reachable_timeout          = 300 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.enforce_new_defaults = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.enforce_scope      = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.policy_default_rule = default {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.connection_string     = messaging:// {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.enabled               = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.es_doc_type           = notification {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.es_scroll_size        = 10000 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.es_scroll_time        = 2m {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.filter_error_trace    = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.hmac_keys             = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.sentinel_service_name = mymaster {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.socket_timeout        = 0.1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.trace_requests        = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler.trace_sqlalchemy      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler_jaeger.process_tags   = {} {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler_jaeger.service_name_prefix = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] profiler_otlp.service_name_prefix = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] remote_debug.host              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] remote_debug.port              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_notifications.retry = -1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.auth_section        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.auth_type           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.cafile              = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.certfile            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.collect_timing      = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.connect_retries     = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.connect_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.endpoint_id         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.endpoint_override   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.insecure            = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.keyfile             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.max_version         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.min_version         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.region_name         = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.service_name        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.service_type        = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.split_loggers       = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.status_code_retries = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.status_code_retry_delay = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.timeout             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.valid_interfaces    = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_limit.version             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_reports.file_event_handler = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] oslo_reports.log_dir           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.group  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] vif_plug_ovs_privileged.user   = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.isolate_vif         = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] os_brick.lock_path             = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.capabilities   = [21] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.group          = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.helper_command = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] privsep_osbrick.user           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.group           = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.helper_command  = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] nova_sys_admin.user            = None {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG oslo_service.service [None req-7b9cf6ed-254a-4a3c-8cf3-7d7d78d93502 None None] ******************************************************************************** {{(pid=72620) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 09 20:36:46 user nova-compute[72620]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Starting native event thread {{(pid=72620) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Starting green dispatch thread {{(pid=72620) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Starting connection event dispatch thread {{(pid=72620) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Connecting to libvirt: qemu:///system {{(pid=72620) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4c690d8af0> {{(pid=72620) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4c690d8af0> {{(pid=72620) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 09 20:36:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Connection event '1' reason 'None'
Aug 09 20:36:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 20:36:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.mount [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Initialising _HostMountState generation 0 {{(pid=72620) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 09 20:36:53 user nova-compute[72620]: INFO nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host capabilities <capabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <host>
Aug 09 20:36:53 user nova-compute[72620]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 09 20:36:53 user nova-compute[72620]:     <cpu>
Aug 09 20:36:53 user nova-compute[72620]:       <arch>x86_64</arch>
Aug 09 20:36:53 user nova-compute[72620]:       <model>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <microcode version='1070'/>
Aug 09 20:36:53 user nova-compute[72620]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='osxsave'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='invtsc'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='rsba'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature name='skip-l1dfl-vmentry'/>
Aug 09 20:36:53 user nova-compute[72620]:       <pages unit='KiB' size='4'/>
Aug 09 20:36:53 user nova-compute[72620]:       <pages unit='KiB' size='2048'/>
Aug 09 20:36:53 user nova-compute[72620]:     </cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <power_management>
Aug 09 20:36:53 user nova-compute[72620]:       <suspend_mem/>
Aug 09 20:36:53 user nova-compute[72620]:       <suspend_disk/>
Aug 09 20:36:53 user nova-compute[72620]:       <suspend_hybrid/>
Aug 09 20:36:53 user nova-compute[72620]:     </power_management>
Aug 09 20:36:53 user nova-compute[72620]:     <iommu support='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <migration_features>
Aug 09 20:36:53 user nova-compute[72620]:       <live/>
Aug 09 20:36:53 user nova-compute[72620]:       <uri_transports>
Aug 09 20:36:53 user nova-compute[72620]:         <uri_transport>tcp</uri_transport>
Aug 09 20:36:53 user nova-compute[72620]:         <uri_transport>rdma</uri_transport>
Aug 09 20:36:53 user nova-compute[72620]:       </uri_transports>
Aug 09 20:36:53 user nova-compute[72620]:     </migration_features>
Aug 09 20:36:53 user nova-compute[72620]:     <topology>
Aug 09 20:36:53 user nova-compute[72620]:       <cells num='2'>
Aug 09 20:36:53 user nova-compute[72620]:         <cell id='0'>
Aug 09 20:36:53 user nova-compute[72620]:           <memory unit='KiB'>8189224</memory>
Aug 09 20:36:53 user nova-compute[72620]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 09 20:36:53 user nova-compute[72620]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 20:36:53 user nova-compute[72620]:           <distances>
Aug 09 20:36:53 user nova-compute[72620]:             <sibling id='0' value='10'/>
Aug 09 20:36:53 user nova-compute[72620]:             <sibling id='1' value='20'/>
Aug 09 20:36:53 user nova-compute[72620]:           </distances>
Aug 09 20:36:53 user nova-compute[72620]:           <cpus num='6'>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 09 20:36:53 user nova-compute[72620]:           </cpus>
Aug 09 20:36:53 user nova-compute[72620]:         </cell>
Aug 09 20:36:53 user nova-compute[72620]:         <cell id='1'>
Aug 09 20:36:53 user nova-compute[72620]:           <memory unit='KiB'>8206460</memory>
Aug 09 20:36:53 user nova-compute[72620]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 09 20:36:53 user nova-compute[72620]:           <pages unit='KiB' size='2048'>0</pages>
Aug 09 20:36:53 user nova-compute[72620]:           <distances>
Aug 09 20:36:53 user nova-compute[72620]:             <sibling id='0' value='20'/>
Aug 09 20:36:53 user nova-compute[72620]:             <sibling id='1' value='10'/>
Aug 09 20:36:53 user nova-compute[72620]:           </distances>
Aug 09 20:36:53 user nova-compute[72620]:           <cpus num='6'>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 09 20:36:53 user nova-compute[72620]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 09 20:36:53 user nova-compute[72620]:           </cpus>
Aug 09 20:36:53 user nova-compute[72620]:         </cell>
Aug 09 20:36:53 user nova-compute[72620]:       </cells>
Aug 09 20:36:53 user nova-compute[72620]:     </topology>
Aug 09 20:36:53 user nova-compute[72620]:     <cache>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 09 20:36:53 user nova-compute[72620]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 09 20:36:53 user nova-compute[72620]:     </cache>
Aug 09 20:36:53 user nova-compute[72620]:     <secmodel>
Aug 09 20:36:53 user nova-compute[72620]:       <model>apparmor</model>
Aug 09 20:36:53 user nova-compute[72620]:       <doi>0</doi>
Aug 09 20:36:53 user nova-compute[72620]:     </secmodel>
Aug 09 20:36:53 user nova-compute[72620]:     <secmodel>
Aug 09 20:36:53 user nova-compute[72620]:       <model>dac</model>
Aug 09 20:36:53 user nova-compute[72620]:       <doi>0</doi>
Aug 09 20:36:53 user nova-compute[72620]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 09 20:36:53 user nova-compute[72620]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 09 20:36:53 user nova-compute[72620]:     </secmodel>
Aug 09 20:36:53 user nova-compute[72620]:   </host>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='alpha'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>clipper</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='armv6l'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>spitz</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>nuri</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>kzm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>z2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>tosa</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n810</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>terrier</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>midway</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>microbit</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>verdex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>highbank</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>akita</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>connex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>collie</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='armv7l'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>spitz</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>nuri</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>kzm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>z2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>tosa</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n810</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>terrier</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>midway</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>microbit</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>verdex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>highbank</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>akita</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>connex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>collie</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='aarch64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>integratorcp</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>borzoi</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>spitz</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>nuri</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-b1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatileab</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>kzm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>musca-a</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>smdkc210</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>z2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>tosa</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>sabrelite</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-eb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n810</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>n800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>versatilepb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>terrier</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mainstone</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>midway</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>musicpal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>microbit</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cubieboard</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>verdex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduino2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>raspi3b</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>raspi2b</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>cheetah</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>highbank</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>akita</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>connex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>collie</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>raspi0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <acpi default='on' toggle='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='cris'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='i686'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>isapc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>microvm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='kvm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <pae/>
Aug 09 20:36:53 user nova-compute[72620]:       <nonpae/>
Aug 09 20:36:53 user nova-compute[72620]:       <acpi default='on' toggle='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:       <apic default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='m68k'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>an5206</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>q800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>next-cube</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='microblaze'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='microblazeel'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='mips'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>malta</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='mipsel'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>malta</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='mips64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>malta</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>pica61</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>magnum</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='mips64el'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>malta</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mipssim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>pica61</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>magnum</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='16'>boston</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='ppc'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mac99</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>40p</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>taihu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='ppc64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>taihu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>40p</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mac99</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='ppc64le'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>taihu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ppce500</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>40p</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>pegasos2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>bamboo</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>g3beige</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>mac99</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sam460ex</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>ref405ep</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2048'>powernv8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='riscv32'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='8'>spike</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>opentitan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='8'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='riscv64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='8'>spike</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='5'>sifive_u</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>shakti_c</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sifive_e</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='8'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='s390x'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='sh4'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>shix</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>r2d</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='sh4eb'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>shix</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>r2d</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='sparc'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>SS-5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>SS-20</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>LX</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>SS-4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>SS-10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>Voyager</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='sparc64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sun4u</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>niagara</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>sun4v</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='x86_64'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>64</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>x-remote</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='1'>isapc</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>microvm</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='kvm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <acpi default='on' toggle='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:       <apic default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='xtensa'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>sim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>kc705</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ml605</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx200</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx60</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]:   <guest>
Aug 09 20:36:53 user nova-compute[72620]:     <os_type>hvm</os_type>
Aug 09 20:36:53 user nova-compute[72620]:     <arch name='xtensaeb'>
Aug 09 20:36:53 user nova-compute[72620]:       <wordsize>32</wordsize>
Aug 09 20:36:53 user nova-compute[72620]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='4'>sim</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>kc705</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ml605</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>virt</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx200</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>lx60</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 09 20:36:53 user nova-compute[72620]:       <domain type='qemu'/>
Aug 09 20:36:53 user nova-compute[72620]:     </arch>
Aug 09 20:36:53 user nova-compute[72620]:     <features>
Aug 09 20:36:53 user nova-compute[72620]:       <cpuselection/>
Aug 09 20:36:53 user nova-compute[72620]:       <deviceboot/>
Aug 09 20:36:53 user nova-compute[72620]:       <disksnapshot default='on' toggle='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     </features>
Aug 09 20:36:53 user nova-compute[72620]:   </guest>
Aug 09 20:36:53 user nova-compute[72620]: </capabilities>
Aug 09 20:36:53 user nova-compute[72620]: 
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-q35-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>i686</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='288'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'/>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='lm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-q35-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>i686</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='288'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'/>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='lm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-i440fx-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>i686</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='255'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'/>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='lm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ide</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-i386</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-i440fx-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>i686</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='255'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'/>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='lm'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ide</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-q35-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>x86_64</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='288'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>efi</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='invtsc'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='rsba'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-q35-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>x86_64</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='288'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>efi</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='invtsc'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='rsba'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-i440fx-6.2</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>x86_64</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='255'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>efi</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='invtsc'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='rsba'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ide</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 09 20:36:53 user nova-compute[72620]: <domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 09 20:36:53 user nova-compute[72620]:   <domain>kvm</domain>
Aug 09 20:36:53 user nova-compute[72620]:   <machine>pc-i440fx-jammy</machine>
Aug 09 20:36:53 user nova-compute[72620]:   <arch>x86_64</arch>
Aug 09 20:36:53 user nova-compute[72620]:   <vcpu max='255'/>
Aug 09 20:36:53 user nova-compute[72620]:   <iothreads supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:   <os supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='firmware'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>efi</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:     <loader supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>rom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pflash</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='readonly'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>yes</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='secure'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>no</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </loader>
Aug 09 20:36:53 user nova-compute[72620]:   </os>
Aug 09 20:36:53 user nova-compute[72620]:   <cpu>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-passthrough' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='hostPassthroughMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='maximum' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='maximumMigratable'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>on</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>off</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='host-model' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <vendor>Intel</vendor>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ss'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='vmx'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pcid'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='hypervisor'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arat'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='tsc_adjust'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='umip'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='md-clear'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='arch-capabilities'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='invtsc'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibpb'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='ibrs'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-stibp'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='amd-ssbd'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='rsba'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='require' name='pschange-mc-no'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='erms'/>
Aug 09 20:36:53 user nova-compute[72620]:       <feature policy='disable' name='xsaveopt'/>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:     <mode name='custom' supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>qemu64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>qemu32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>phenom</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>pentium</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>n270</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm64</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>kvm32</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>coreduo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>core2duo</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>athlon</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Westmere</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Snowridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Skylake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>SandyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Penryn</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G5</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G4</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G3</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Opteron_G2</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Opteron_G1</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>IvyBridge</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Icelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Haswell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Rome</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-Milan</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC-IBPB</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>EPYC</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Dhyana</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cooperlake</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>Conroe</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Cascadelake-Server</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-noTSX</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell-IBRS</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='no'>Broadwell</model>
Aug 09 20:36:53 user nova-compute[72620]:       <model usable='yes'>486</model>
Aug 09 20:36:53 user nova-compute[72620]:     </mode>
Aug 09 20:36:53 user nova-compute[72620]:   </cpu>
Aug 09 20:36:53 user nova-compute[72620]:   <memoryBacking supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:     <enum name='sourceType'>
Aug 09 20:36:53 user nova-compute[72620]:       <value>file</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>anonymous</value>
Aug 09 20:36:53 user nova-compute[72620]:       <value>memfd</value>
Aug 09 20:36:53 user nova-compute[72620]:     </enum>
Aug 09 20:36:53 user nova-compute[72620]:   </memoryBacking>
Aug 09 20:36:53 user nova-compute[72620]:   <devices>
Aug 09 20:36:53 user nova-compute[72620]:     <disk supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='diskDevice'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>disk</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cdrom</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>floppy</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>lun</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='bus'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ide</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>fdc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sata</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </disk>
Aug 09 20:36:53 user nova-compute[72620]:     <graphics supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='type'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>sdl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vnc</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>spice</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egl-headless</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </graphics>
Aug 09 20:36:53 user nova-compute[72620]:     <video supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='modelType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>cirrus</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>vmvga</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>qxl</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>none</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>bochs</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>ramfb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </video>
Aug 09 20:36:53 user nova-compute[72620]:     <hostdev supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='mode'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>subsystem</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='startupPolicy'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>default</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>mandatory</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>requisite</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>optional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='subsysType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>usb</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>pci</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>scsi</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='capsType'/>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='pciBackend'/>
Aug 09 20:36:53 user nova-compute[72620]:     </hostdev>
Aug 09 20:36:53 user nova-compute[72620]:     <rng supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtio-non-transitional</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>random</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>egd</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>builtin</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </rng>
Aug 09 20:36:53 user nova-compute[72620]:     <filesystem supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='driverType'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>path</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>handle</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>virtiofs</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </filesystem>
Aug 09 20:36:53 user nova-compute[72620]:     <tpm supported='yes'>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='model'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-tis</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>tpm-crb</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:       <enum name='backendModel'>
Aug 09 20:36:53 user nova-compute[72620]:         <value>passthrough</value>
Aug 09 20:36:53 user nova-compute[72620]:         <value>emulator</value>
Aug 09 20:36:53 user nova-compute[72620]:       </enum>
Aug 09 20:36:53 user nova-compute[72620]:     </tpm>
Aug 09 20:36:53 user nova-compute[72620]:   </devices>
Aug 09 20:36:53 user nova-compute[72620]:   <features>
Aug 09 20:36:53 user nova-compute[72620]:     <gic supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:     <vmcoreinfo supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <genid supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backingStoreInput supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <backup supported='yes'/>
Aug 09 20:36:53 user nova-compute[72620]:     <sev supported='no'/>
Aug 09 20:36:53 user nova-compute[72620]:   </features>
Aug 09 20:36:53 user nova-compute[72620]: </domainCapabilities>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72620) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72620) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Checking secure boot support for host arch (x86_64) {{(pid=72620) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 09 20:36:53 user nova-compute[72620]: INFO nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Secure Boot support detected
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] cpu compare xml: <cpu match="exact">
Aug 09 20:36:53 user nova-compute[72620]:   <model>Nehalem</model>
Aug 09 20:36:53 user nova-compute[72620]: </cpu>
Aug 09 20:36:53 user nova-compute[72620]:  {{(pid=72620) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 09 20:36:53 user nova-compute[72620]: INFO nova.virt.node [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Generated node identity bf3cd726-0758-4dff-9e6c-ef2d0988f3d1
Aug 09 20:36:53 user nova-compute[72620]: INFO nova.virt.node [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Wrote node identity bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 to /opt/stack/data/nova/compute_id
Aug 09 20:36:53 user nova-compute[72620]: WARNING nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Compute nodes ['bf3cd726-0758-4dff-9e6c-ef2d0988f3d1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 09 20:36:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 09 20:36:53 user nova-compute[72620]: WARNING nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 09 20:36:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:36:53 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:36:54 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:36:54 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Hypervisor/Node resource view: name=user free_ram=10896MB free_disk=26.30771255493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:36:54 user nova-compute[72620]: WARNING nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] No compute node record for user:bf3cd726-0758-4dff-9e6c-ef2d0988f3d1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 could not be found.
Aug 09 20:36:54 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Compute node record created for user:user with uuid: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:36:54 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [req-edfe8178-3331-465f-849b-22ea5cac8e00] Created resource provider record via placement API for resource provider with UUID bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 and name user.
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72620) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 09 20:36:54 user nova-compute[72620]: INFO nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] kernel doesn't support AMD SEV
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Libvirt baseline CPU <cpu>
Aug 09 20:36:54 user nova-compute[72620]:   <arch>x86_64</arch>
Aug 09 20:36:54 user nova-compute[72620]:   <model>Nehalem</model>
Aug 09 20:36:54 user nova-compute[72620]:   <vendor>Intel</vendor>
Aug 09 20:36:54 user nova-compute[72620]:   <topology sockets="6" cores="1" threads="1"/>
Aug 09 20:36:54 user nova-compute[72620]: </cpu>
Aug 09 20:36:54 user nova-compute[72620]:  {{(pid=72620) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Updated inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Updating resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 generation from 0 to 1 during operation: update_inventory {{(pid=72620) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Updating resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 generation from 1 to 2 during operation: update_traits {{(pid=72620) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.service [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Creating RPC server for service compute {{(pid=72620) start /opt/stack/nova/nova/service.py:182}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.service [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Join ServiceGroup membership for this service compute {{(pid=72620) start /opt/stack/nova/nova/service.py:199}}
Aug 09 20:36:54 user nova-compute[72620]: DEBUG nova.servicegroup.drivers.db [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72620) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 09 20:37:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:37:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:37:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:37:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=10249MB free_disk=26.212310791015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:37:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:38:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:38:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=26.2041015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:38:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:38:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:38:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:39:47 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:39:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:39:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=10170MB free_disk=26.14215850830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:39:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.094s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:39:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:40:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:40:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:40:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:40:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:40:49 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:40:50 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:40:50 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.074440002441406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:40:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.127s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:20 user nova-compute[72620]: INFO nova.compute.claims [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Claim successful on node user
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Creating image(s)
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.policy [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62ad594d1d64a5e9c14551b4d87e6e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c3a5764804c1ab1c5cde902ed6596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.virt.images [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] e5cbb687-0055-4eb1-92d5-736844e9b958 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.part /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:22 user nova-compute[72620]: INFO nova.compute.claims [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Claim successful on node user
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.part /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.converted" returned: 0 in 0.225s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.802s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:22 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph0cfjkbe/privsep.sock']
Aug 09 20:41:22 user sudo[81821]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph0cfjkbe/privsep.sock
Aug 09 20:41:22 user sudo[81821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:23 user nova-compute[72620]: INFO nova.compute.claims [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Claim successful on node user
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Creating image(s)
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.policy [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62ad594d1d64a5e9c14551b4d87e6e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c3a5764804c1ab1c5cde902ed6596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Creating image(s)
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "/opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "/opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG nova.policy [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fb47bde8c4e4dcca773c5de60a54b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '961e3f5814f24c00a788497482bc5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:24 user sudo[81821]: pam_unix(sudo:session): session closed for user root
Aug 09 20:41:24 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Spawned new privsep daemon via rootwrap
Aug 09 20:41:24 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 20:41:24 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 20:41:24 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 09 20:41:24 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81826
Aug 09 20:41:24 user nova-compute[72620]: WARNING oslo_privsep.priv_context [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] privsep daemon already running
Aug 09 20:41:24 user nova-compute[72620]: WARNING oslo_privsep.priv_context [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] privsep daemon already running
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.181s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.191s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk 1073741824" returned: 0 in 0.062s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.193s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk 1073741824" returned: 0 in 0.048s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.426s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Successfully created port: 462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Cannot resize image /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Ensure instance console log exists: /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk 1073741824" returned: 0 in 0.050s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Cannot resize image /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Ensure instance console log exists: /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Cannot resize image /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:41:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lazy-loading 'migration_context' on Instance uuid fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Ensure instance console log exists: /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Successfully created port: 46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:41:27 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Successfully created port: 79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:28 user nova-compute[72620]: INFO nova.compute.claims [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Claim successful on node user
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Creating image(s)
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.policy [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5346961c66f84f0cbc929b2de7d72485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98aa07c3778141cfbf35d9fd26289d02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.159s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk 1073741824" returned: 0 in 0.044s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Cannot resize image /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.objects.instance [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'migration_context' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Ensure instance console log exists: /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Successfully updated port: 462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Successfully updated port: 46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-changed-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Refreshing instance network info cache due to event network-changed-462bce5d-1459-44eb-8115-88087cc6ec6c. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-changed-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Refreshing instance network info cache due to event network-changed-46aca639-e25b-4982-962c-e0999eab9bc5. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:41:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Successfully updated port: 79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquired lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance network_info: |[{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Refreshing network info cache for port 462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start _get_guest_xml network_info=[{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:41:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493500109',display_name='tempest-ServerRescueNegativeTestJSON-server-1493500109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493500109',id=1,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-rhv465p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:21Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=df3a42a3-a50e-48d0-8962-2f77d4dea766,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:41:31 user nova-compute[72620]:   <uuid>df3a42a3-a50e-48d0-8962-2f77d4dea766</uuid>
Aug 09 20:41:31 user nova-compute[72620]:   <name>instance-00000001</name>
Aug 09 20:41:31 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:41:31 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:41:31 user nova-compute[72620]:   <metadata>
Aug 09 20:41:31 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:41:31 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1493500109</nova:name>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:41:31</nova:creationTime>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:41:31 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:41:31 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:owner>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:41:31 user nova-compute[72620]:       </nova:owner>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:41:31 user nova-compute[72620]:       <nova:ports>
Aug 09 20:41:31 user nova-compute[72620]:         <nova:port uuid="462bce5d-1459-44eb-8115-88087cc6ec6c">
Aug 09 20:41:31 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:41:31 user nova-compute[72620]:         </nova:port>
Aug 09 20:41:31 user nova-compute[72620]:       </nova:ports>
Aug 09 20:41:31 user nova-compute[72620]:     </nova:instance>
Aug 09 20:41:31 user nova-compute[72620]:   </metadata>
Aug 09 20:41:31 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:41:31 user nova-compute[72620]:     <system>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="serial">df3a42a3-a50e-48d0-8962-2f77d4dea766</entry>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="uuid">df3a42a3-a50e-48d0-8962-2f77d4dea766</entry>
Aug 09 20:41:31 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:41:31 user nova-compute[72620]:     </system>
Aug 09 20:41:31 user nova-compute[72620]:   </sysinfo>
Aug 09 20:41:31 user nova-compute[72620]:   <os>
Aug 09 20:41:31 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:41:31 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:41:31 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:41:31 user nova-compute[72620]:   </os>
Aug 09 20:41:31 user nova-compute[72620]:   <features>
Aug 09 20:41:31 user nova-compute[72620]:     <acpi/>
Aug 09 20:41:31 user nova-compute[72620]:     <apic/>
Aug 09 20:41:31 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:41:31 user nova-compute[72620]:   </features>
Aug 09 20:41:31 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:41:31 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:41:31 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:41:31 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:41:31 user nova-compute[72620]:   </clock>
Aug 09 20:41:31 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:41:31 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:41:31 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:41:31 user nova-compute[72620]:   </cpu>
Aug 09 20:41:31 user nova-compute[72620]:   <devices>
Aug 09 20:41:31 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:41:31 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:41:31 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk"/>
Aug 09 20:41:31 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:41:31 user nova-compute[72620]:     </disk>
Aug 09 20:41:31 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:41:31 user nova-compute[72620]:       <mac address="fa:16:3e:30:3a:76"/>
Aug 09 20:41:31 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:31 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:41:31 user nova-compute[72620]:       <target dev="tap462bce5d-14"/>
Aug 09 20:41:31 user nova-compute[72620]:     </interface>
Aug 09 20:41:31 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:41:31 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/console.log" append="off"/>
Aug 09 20:41:31 user nova-compute[72620]:     </serial>
Aug 09 20:41:31 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:41:31 user nova-compute[72620]:     <video>
Aug 09 20:41:31 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:31 user nova-compute[72620]:     </video>
Aug 09 20:41:31 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:41:31 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:41:31 user nova-compute[72620]:     </rng>
Aug 09 20:41:31 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:41:31 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:41:31 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:41:31 user nova-compute[72620]:     </memballoon>
Aug 09 20:41:31 user nova-compute[72620]:   </devices>
Aug 09 20:41:31 user nova-compute[72620]: </domain>
Aug 09 20:41:31 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493500109',display_name='tempest-ServerRescueNegativeTestJSON-server-1493500109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493500109',id=1,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-rhv465p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:21Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=df3a42a3-a50e-48d0-8962-2f77d4dea766,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG os_vif [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Created schema index Interface.name {{(pid=72620) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Created schema index Port.name {{(pid=72620) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Created schema index Bridge.name {{(pid=72620) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [POLLOUT] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance network_info: |[{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Refreshing network info cache for port 46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start _get_guest_xml network_info=[{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:41:32 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_xhvu3rn/privsep.sock']
Aug 09 20:41:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:41:32 user sudo[81898]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_xhvu3rn/privsep.sock
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:41:32 user sudo[81898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355704383',display_name='tempest-ServerRescueNegativeTestJSON-server-355704383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355704383',id=2,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-msw2d2fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:23Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fd67d539-7cdf-4abc-a32e-d98f6be67e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:41:32 user nova-compute[72620]:   <uuid>fd67d539-7cdf-4abc-a32e-d98f6be67e1b</uuid>
Aug 09 20:41:32 user nova-compute[72620]:   <name>instance-00000002</name>
Aug 09 20:41:32 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:41:32 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:41:32 user nova-compute[72620]:   <metadata>
Aug 09 20:41:32 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:41:32 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355704383</nova:name>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:41:32</nova:creationTime>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:41:32 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:owner>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:owner>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:ports>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:port uuid="46aca639-e25b-4982-962c-e0999eab9bc5">
Aug 09 20:41:32 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:41:32 user nova-compute[72620]:         </nova:port>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:ports>
Aug 09 20:41:32 user nova-compute[72620]:     </nova:instance>
Aug 09 20:41:32 user nova-compute[72620]:   </metadata>
Aug 09 20:41:32 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:41:32 user nova-compute[72620]:     <system>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="serial">fd67d539-7cdf-4abc-a32e-d98f6be67e1b</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="uuid">fd67d539-7cdf-4abc-a32e-d98f6be67e1b</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:41:32 user nova-compute[72620]:     </system>
Aug 09 20:41:32 user nova-compute[72620]:   </sysinfo>
Aug 09 20:41:32 user nova-compute[72620]:   <os>
Aug 09 20:41:32 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:41:32 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:41:32 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:41:32 user nova-compute[72620]:   </os>
Aug 09 20:41:32 user nova-compute[72620]:   <features>
Aug 09 20:41:32 user nova-compute[72620]:     <acpi/>
Aug 09 20:41:32 user nova-compute[72620]:     <apic/>
Aug 09 20:41:32 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:41:32 user nova-compute[72620]:   </features>
Aug 09 20:41:32 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:41:32 user nova-compute[72620]:   </clock>
Aug 09 20:41:32 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:41:32 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:41:32 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:41:32 user nova-compute[72620]:   </cpu>
Aug 09 20:41:32 user nova-compute[72620]:   <devices>
Aug 09 20:41:32 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:41:32 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:41:32 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk"/>
Aug 09 20:41:32 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:     </disk>
Aug 09 20:41:32 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:41:32 user nova-compute[72620]:       <mac address="fa:16:3e:4d:e8:4e"/>
Aug 09 20:41:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:41:32 user nova-compute[72620]:       <target dev="tap46aca639-e2"/>
Aug 09 20:41:32 user nova-compute[72620]:     </interface>
Aug 09 20:41:32 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:41:32 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/console.log" append="off"/>
Aug 09 20:41:32 user nova-compute[72620]:     </serial>
Aug 09 20:41:32 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:41:32 user nova-compute[72620]:     <video>
Aug 09 20:41:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:     </video>
Aug 09 20:41:32 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:41:32 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:41:32 user nova-compute[72620]:     </rng>
Aug 09 20:41:32 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:41:32 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:41:32 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:41:32 user nova-compute[72620]:     </memballoon>
Aug 09 20:41:32 user nova-compute[72620]:   </devices>
Aug 09 20:41:32 user nova-compute[72620]: </domain>
Aug 09 20:41:32 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355704383',display_name='tempest-ServerRescueNegativeTestJSON-server-355704383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355704383',id=2,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-msw2d2fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:23Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fd67d539-7cdf-4abc-a32e-d98f6be67e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG os_vif [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Successfully created port: dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Updating instance_info_cache with network_info: [{"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Releasing lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Instance network_info: |[{"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Start _get_guest_xml network_info=[{"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:41:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2109987802',display_name='tempest-DeleteServersTestJSON-server-2109987802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2109987802',id=3,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='961e3f5814f24c00a788497482bc5a7c',ramdisk_id='',reservation_id='r-50phryer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2023065016',owner_user_name='tempest-DeleteServersTestJSON-2023065016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:24Z,user_data=None,user_id='3fb47bde8c4e4dcca773c5de60a54b70',uuid=fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converting VIF {"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lazy-loading 'pci_devices' on Instance uuid fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updated VIF entry in instance network info cache for port 462bce5d-1459-44eb-8115-88087cc6ec6c. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:41:32 user nova-compute[72620]:   <uuid>fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc</uuid>
Aug 09 20:41:32 user nova-compute[72620]:   <name>instance-00000003</name>
Aug 09 20:41:32 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:41:32 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:41:32 user nova-compute[72620]:   <metadata>
Aug 09 20:41:32 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:41:32 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:name>tempest-DeleteServersTestJSON-server-2109987802</nova:name>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:41:32</nova:creationTime>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:41:32 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:owner>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:user uuid="3fb47bde8c4e4dcca773c5de60a54b70">tempest-DeleteServersTestJSON-2023065016-project-member</nova:user>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:project uuid="961e3f5814f24c00a788497482bc5a7c">tempest-DeleteServersTestJSON-2023065016</nova:project>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:owner>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:41:32 user nova-compute[72620]:       <nova:ports>
Aug 09 20:41:32 user nova-compute[72620]:         <nova:port uuid="79856a57-2542-4788-a2ea-98324847e670">
Aug 09 20:41:32 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:41:32 user nova-compute[72620]:         </nova:port>
Aug 09 20:41:32 user nova-compute[72620]:       </nova:ports>
Aug 09 20:41:32 user nova-compute[72620]:     </nova:instance>
Aug 09 20:41:32 user nova-compute[72620]:   </metadata>
Aug 09 20:41:32 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:41:32 user nova-compute[72620]:     <system>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="serial">fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="uuid">fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc</entry>
Aug 09 20:41:32 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:41:32 user nova-compute[72620]:     </system>
Aug 09 20:41:32 user nova-compute[72620]:   </sysinfo>
Aug 09 20:41:32 user nova-compute[72620]:   <os>
Aug 09 20:41:32 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:41:32 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:41:32 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:41:32 user nova-compute[72620]:   </os>
Aug 09 20:41:32 user nova-compute[72620]:   <features>
Aug 09 20:41:32 user nova-compute[72620]:     <acpi/>
Aug 09 20:41:32 user nova-compute[72620]:     <apic/>
Aug 09 20:41:32 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:41:32 user nova-compute[72620]:   </features>
Aug 09 20:41:32 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:41:32 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:41:32 user nova-compute[72620]:   </clock>
Aug 09 20:41:32 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:41:32 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:41:32 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:41:32 user nova-compute[72620]:   </cpu>
Aug 09 20:41:32 user nova-compute[72620]:   <devices>
Aug 09 20:41:32 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:41:32 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:41:32 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk"/>
Aug 09 20:41:32 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:     </disk>
Aug 09 20:41:32 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:41:32 user nova-compute[72620]:       <mac address="fa:16:3e:04:1c:7e"/>
Aug 09 20:41:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:41:32 user nova-compute[72620]:       <target dev="tap79856a57-25"/>
Aug 09 20:41:32 user nova-compute[72620]:     </interface>
Aug 09 20:41:32 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:41:32 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/console.log" append="off"/>
Aug 09 20:41:32 user nova-compute[72620]:     </serial>
Aug 09 20:41:32 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:41:32 user nova-compute[72620]:     <video>
Aug 09 20:41:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:32 user nova-compute[72620]:     </video>
Aug 09 20:41:32 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:41:32 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:41:32 user nova-compute[72620]:     </rng>
Aug 09 20:41:32 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:41:32 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:41:32 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:41:32 user nova-compute[72620]:     </memballoon>
Aug 09 20:41:32 user nova-compute[72620]:   </devices>
Aug 09 20:41:32 user nova-compute[72620]: </domain>
Aug 09 20:41:32 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2109987802',display_name='tempest-DeleteServersTestJSON-server-2109987802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2109987802',id=3,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='961e3f5814f24c00a788497482bc5a7c',ramdisk_id='',reservation_id='r-50phryer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2023065016',owner_user_name='tempest-DeleteServersTestJSON-2023065016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:24Z,user_data=None,user_id='3fb47bde8c4e4dcca773c5de60a54b70',uuid=fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converting VIF {"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG os_vif [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f2cb1eeb-7bf4-4d5f-8ba4-4df543cee582 req-e80caa81-1e7d-4664-9e2a-153af8894698 service nova] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-changed-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Refreshing instance network info cache due to event network-changed-79856a57-2542-4788-a2ea-98324847e670. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] Acquiring lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] Acquired lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Refreshing network info cache for port 79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:41:33 user sudo[81898]: pam_unix(sudo:session): session closed for user root
Aug 09 20:41:33 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Spawned new privsep daemon via rootwrap
Aug 09 20:41:33 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 20:41:33 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 20:41:33 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 09 20:41:33 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81905
Aug 09 20:41:33 user nova-compute[72620]: WARNING oslo_privsep.priv_context [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] privsep daemon already running
Aug 09 20:41:33 user nova-compute[72620]: WARNING oslo_privsep.priv_context [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] privsep daemon already running
Aug 09 20:41:33 user nova-compute[72620]: DEBUG nova.network.neutron [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updated VIF entry in instance network info cache for port 46aca639-e25b-4982-962c-e0999eab9bc5. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:41:33 user nova-compute[72620]: DEBUG nova.network.neutron [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5046bc3e-1cc4-40b2-9f16-b6cf9f85a6ec req-26ee87e5-1f44-47e5-85b1-7e059703cc0c service nova] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Updated VIF entry in instance network info cache for port 79856a57-2542-4788-a2ea-98324847e670. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Updating instance_info_cache with network_info: [{"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7dbfc690-a3a5-47c9-ae01-36ab8e3682e5 req-b738c4cb-66ab-4c15-8869-f26d21f3edde service nova] Releasing lock "refresh_cache-fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46aca639-e2, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46aca639-e2, col_values=(('external_ids', {'iface-id': '46aca639-e25b-4982-962c-e0999eab9bc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:e8:4e', 'vm-uuid': 'fd67d539-7cdf-4abc-a32e-d98f6be67e1b'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: INFO os_vif [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2')
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap462bce5d-14, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap462bce5d-14, col_values=(('external_ids', {'iface-id': '462bce5d-1459-44eb-8115-88087cc6ec6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:3a:76', 'vm-uuid': 'df3a42a3-a50e-48d0-8962-2f77d4dea766'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: INFO os_vif [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14')
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79856a57-25, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79856a57-25, col_values=(('external_ids', {'iface-id': '79856a57-2542-4788-a2ea-98324847e670', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:1c:7e', 'vm-uuid': 'fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:34 user nova-compute[72620]: INFO os_vif [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25')
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:4d:e8:4e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:30:3a:76, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] No VIF found with MAC fa:16:3e:04:1c:7e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:41:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Successfully updated port: dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-changed-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Refreshing instance network info cache due to event network-changed-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:35 user nova-compute[72620]: INFO nova.compute.claims [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Claim successful on node user
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Creating image(s)
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG nova.policy [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e03fddb657b24c97a984041ad12da65a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af525394a7ce4d518ba31b48cc4de994', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.125s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk 1073741824" returned: 0 in 0.046s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Checking if we can resize image /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Cannot resize image /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'migration_context' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Ensure instance console log exists: /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance network_info: |[{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.neutron [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Refreshing network info cache for port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start _get_guest_xml network_info=[{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:41:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'pci_devices' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:41:37 user nova-compute[72620]:   <uuid>e96165b1-5eca-4530-821e-b00b66710ca1</uuid>
Aug 09 20:41:37 user nova-compute[72620]:   <name>instance-00000004</name>
Aug 09 20:41:37 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:41:37 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:41:37 user nova-compute[72620]:   <metadata>
Aug 09 20:41:37 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:41:37 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherB-server-1923729587</nova:name>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:41:37</nova:creationTime>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:41:37 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:41:37 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:owner>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:user uuid="5346961c66f84f0cbc929b2de7d72485">tempest-ServerActionsTestOtherB-257906244-project-member</nova:user>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:project uuid="98aa07c3778141cfbf35d9fd26289d02">tempest-ServerActionsTestOtherB-257906244</nova:project>
Aug 09 20:41:37 user nova-compute[72620]:       </nova:owner>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:41:37 user nova-compute[72620]:       <nova:ports>
Aug 09 20:41:37 user nova-compute[72620]:         <nova:port uuid="dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd">
Aug 09 20:41:37 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 20:41:37 user nova-compute[72620]:         </nova:port>
Aug 09 20:41:37 user nova-compute[72620]:       </nova:ports>
Aug 09 20:41:37 user nova-compute[72620]:     </nova:instance>
Aug 09 20:41:37 user nova-compute[72620]:   </metadata>
Aug 09 20:41:37 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:41:37 user nova-compute[72620]:     <system>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="serial">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="uuid">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:41:37 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:41:37 user nova-compute[72620]:     </system>
Aug 09 20:41:37 user nova-compute[72620]:   </sysinfo>
Aug 09 20:41:37 user nova-compute[72620]:   <os>
Aug 09 20:41:37 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:41:37 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:41:37 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:41:37 user nova-compute[72620]:   </os>
Aug 09 20:41:37 user nova-compute[72620]:   <features>
Aug 09 20:41:37 user nova-compute[72620]:     <acpi/>
Aug 09 20:41:37 user nova-compute[72620]:     <apic/>
Aug 09 20:41:37 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:41:37 user nova-compute[72620]:   </features>
Aug 09 20:41:37 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:41:37 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:41:37 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:41:37 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:41:37 user nova-compute[72620]:   </clock>
Aug 09 20:41:37 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:41:37 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:41:37 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:41:37 user nova-compute[72620]:   </cpu>
Aug 09 20:41:37 user nova-compute[72620]:   <devices>
Aug 09 20:41:37 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:41:37 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:41:37 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk"/>
Aug 09 20:41:37 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:41:37 user nova-compute[72620]:     </disk>
Aug 09 20:41:37 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:41:37 user nova-compute[72620]:       <mac address="fa:16:3e:d5:05:b1"/>
Aug 09 20:41:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:37 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:41:37 user nova-compute[72620]:       <target dev="tapdfdabb0b-cb"/>
Aug 09 20:41:37 user nova-compute[72620]:     </interface>
Aug 09 20:41:37 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:41:37 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/console.log" append="off"/>
Aug 09 20:41:37 user nova-compute[72620]:     </serial>
Aug 09 20:41:37 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:41:37 user nova-compute[72620]:     <video>
Aug 09 20:41:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:37 user nova-compute[72620]:     </video>
Aug 09 20:41:37 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:41:37 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:41:37 user nova-compute[72620]:     </rng>
Aug 09 20:41:37 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:41:37 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:41:37 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:41:37 user nova-compute[72620]:     </memballoon>
Aug 09 20:41:37 user nova-compute[72620]:   </devices>
Aug 09 20:41:37 user nova-compute[72620]: </domain>
Aug 09 20:41:37 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG os_vif [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdabb0b-cb, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfdabb0b-cb, col_values=(('external_ids', {'iface-id': 'dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:05:b1', 'vm-uuid': 'e96165b1-5eca-4530-821e-b00b66710ca1'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: INFO os_vif [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No VIF found with MAC fa:16:3e:d5:05:b1, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] No waiting events found dispatching network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:38 user nova-compute[72620]: WARNING nova.compute.manager [req-ae2a2aaf-1248-49ed-bad0-db2f614b0187 req-305128a4-4679-4b60-b9b4-1e9b99cb0090 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received unexpected event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 for instance with vm_state building and task_state spawning.
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updated VIF entry in instance network info cache for port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b810d717-3841-4301-bf0c-0f0c10057f16 req-e62dd11c-ef01-4508-a48e-802006b23383 service nova] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:39 user nova-compute[72620]: WARNING nova.compute.manager [req-46b08ff1-2d22-41a7-82bf-f7984b60de8f req-64ada9db-10b8-4c84-8e1a-a78c2a29d1eb service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state building and task_state spawning.
Aug 09 20:41:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Successfully created port: 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] No waiting events found dispatching network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:40 user nova-compute[72620]: WARNING nova.compute.manager [req-b8b62fa9-03ff-4473-a918-67836de0c6b6 req-403d7b93-bd89-4a87-b866-d08d1a722a93 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received unexpected event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 for instance with vm_state building and task_state spawning.
Aug 09 20:41:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:41 user nova-compute[72620]: WARNING nova.compute.manager [req-2deb7997-e342-4faf-a72f-a82c0183b399 req-11bf7339-e04b-47fc-b816-a631778dd75e service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state building and task_state spawning.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.2639718, fd67d539-7cdf-4abc-a32e-d98f6be67e1b => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] VM Resumed (Lifecycle Event)
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance spawned successfully.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.2687597, fd67d539-7cdf-4abc-a32e-d98f6be67e1b => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] VM Started (Lifecycle Event)
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance spawned successfully.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Took 19.21 seconds to spawn the instance on the hypervisor.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.464183, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Resumed (Lifecycle Event)
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Instance spawned successfully.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.4654644, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Started (Lifecycle Event)
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:42 user nova-compute[72620]: INFO nova.compute.manager [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Took 20.39 seconds to build instance.
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6104b484-5268-4420-b5ca-d455e8eb5cab tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.686s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.5718985, fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] VM Resumed (Lifecycle Event)
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Took 22.17 seconds to spawn the instance on the hypervisor.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Took 19.36 seconds to spawn the instance on the hypervisor.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613702.5807014, fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] VM Started (Lifecycle Event)
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Took 23.13 seconds to build instance.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-451a581c-9eaf-4bcb-9978-8d14c709b6ea tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.394s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Took 20.29 seconds to build instance.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613703.5530808, e96165b1-5eca-4530-821e-b00b66710ca1 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Resumed (Lifecycle Event)
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance spawned successfully.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68f0201b-f4a2-4352-ab78-3f6504fcc26d tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.536s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613703.5571675, e96165b1-5eca-4530-821e-b00b66710ca1 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Started (Lifecycle Event)
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:43 user nova-compute[72620]: INFO nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Took 14.80 seconds to spawn the instance on the hypervisor.
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:43 user nova-compute[72620]: WARNING nova.compute.manager [req-588e603c-db40-425c-8ff8-63decc6c4bfc req-f8a874d7-c3f9-40e8-9a0c-09f314567c7e service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state None.
Aug 09 20:41:44 user nova-compute[72620]: INFO nova.compute.manager [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Took 15.63 seconds to build instance.
Aug 09 20:41:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85166bad-d1f9-464b-8bd1-495ea278979d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.814s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Successfully updated port: 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-changed-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing instance network info cache due to event network-changed-6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance network_info: |[{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start _get_guest_xml network_info=[{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:41:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-339600390',display_name='tempest-ServerStableDeviceRescueTest-server-339600390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-339600390',id=5,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDIw6JRw/5sN0nyPc1O6W4xx94shaFnrSQHNikVNokQNzxYCDxhmAEzzPD4xRuf9T/MZp8fxSDwJBAnTIo95pnqZa8PaZvnwuCpgVmloO1+hrXwWRISRIvajls220qrVg==',key_name='tempest-keypair-900329416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af525394a7ce4d518ba31b48cc4de994',ramdisk_id='',reservation_id='r-o180qqf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-284578307',owner_user_name='tempest-ServerStableDeviceRescueTest-284578307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03fddb657b24c97a984041ad12da65a',uuid=126f0a38-2bd7-4258-bf85-86bfb9c6d4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converting VIF {"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'pci_devices' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:41:46 user nova-compute[72620]:   <uuid>126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</uuid>
Aug 09 20:41:46 user nova-compute[72620]:   <name>instance-00000005</name>
Aug 09 20:41:46 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:41:46 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:41:46 user nova-compute[72620]:   <metadata>
Aug 09 20:41:46 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:41:46 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-339600390</nova:name>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:41:46</nova:creationTime>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:41:46 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:41:46 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:owner>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:user uuid="e03fddb657b24c97a984041ad12da65a">tempest-ServerStableDeviceRescueTest-284578307-project-member</nova:user>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:project uuid="af525394a7ce4d518ba31b48cc4de994">tempest-ServerStableDeviceRescueTest-284578307</nova:project>
Aug 09 20:41:46 user nova-compute[72620]:       </nova:owner>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:41:46 user nova-compute[72620]:       <nova:ports>
Aug 09 20:41:46 user nova-compute[72620]:         <nova:port uuid="6510a428-7366-4a0b-8e14-0518304756c7">
Aug 09 20:41:46 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 20:41:46 user nova-compute[72620]:         </nova:port>
Aug 09 20:41:46 user nova-compute[72620]:       </nova:ports>
Aug 09 20:41:46 user nova-compute[72620]:     </nova:instance>
Aug 09 20:41:46 user nova-compute[72620]:   </metadata>
Aug 09 20:41:46 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:41:46 user nova-compute[72620]:     <system>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="serial">126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</entry>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="uuid">126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</entry>
Aug 09 20:41:46 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:41:46 user nova-compute[72620]:     </system>
Aug 09 20:41:46 user nova-compute[72620]:   </sysinfo>
Aug 09 20:41:46 user nova-compute[72620]:   <os>
Aug 09 20:41:46 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:41:46 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:41:46 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:41:46 user nova-compute[72620]:   </os>
Aug 09 20:41:46 user nova-compute[72620]:   <features>
Aug 09 20:41:46 user nova-compute[72620]:     <acpi/>
Aug 09 20:41:46 user nova-compute[72620]:     <apic/>
Aug 09 20:41:46 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:41:46 user nova-compute[72620]:   </features>
Aug 09 20:41:46 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:41:46 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:41:46 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:41:46 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:41:46 user nova-compute[72620]:   </clock>
Aug 09 20:41:46 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:41:46 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:41:46 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:41:46 user nova-compute[72620]:   </cpu>
Aug 09 20:41:46 user nova-compute[72620]:   <devices>
Aug 09 20:41:46 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:41:46 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:41:46 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk"/>
Aug 09 20:41:46 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:41:46 user nova-compute[72620]:     </disk>
Aug 09 20:41:46 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:41:46 user nova-compute[72620]:       <mac address="fa:16:3e:80:ec:0d"/>
Aug 09 20:41:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:46 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:41:46 user nova-compute[72620]:       <target dev="tap6510a428-73"/>
Aug 09 20:41:46 user nova-compute[72620]:     </interface>
Aug 09 20:41:46 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:41:46 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/console.log" append="off"/>
Aug 09 20:41:46 user nova-compute[72620]:     </serial>
Aug 09 20:41:46 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:41:46 user nova-compute[72620]:     <video>
Aug 09 20:41:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:41:46 user nova-compute[72620]:     </video>
Aug 09 20:41:46 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:41:46 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:41:46 user nova-compute[72620]:     </rng>
Aug 09 20:41:46 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:41:46 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:41:46 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:41:46 user nova-compute[72620]:     </memballoon>
Aug 09 20:41:46 user nova-compute[72620]:   </devices>
Aug 09 20:41:46 user nova-compute[72620]: </domain>
Aug 09 20:41:46 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-339600390',display_name='tempest-ServerStableDeviceRescueTest-server-339600390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-339600390',id=5,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDIw6JRw/5sN0nyPc1O6W4xx94shaFnrSQHNikVNokQNzxYCDxhmAEzzPD4xRuf9T/MZp8fxSDwJBAnTIo95pnqZa8PaZvnwuCpgVmloO1+hrXwWRISRIvajls220qrVg==',key_name='tempest-keypair-900329416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af525394a7ce4d518ba31b48cc4de994',ramdisk_id='',reservation_id='r-o180qqf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-284578307',owner_user_name='tempest-ServerStableDeviceRescueTest-284578307-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03fddb657b24c97a984041ad12da65a',uuid=126f0a38-2bd7-4258-bf85-86bfb9c6d4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converting VIF {"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG os_vif [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6510a428-73, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6510a428-73, col_values=(('external_ids', {'iface-id': '6510a428-7366-4a0b-8e14-0518304756c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ec:0d', 'vm-uuid': '126f0a38-2bd7-4258-bf85-86bfb9c6d4b0'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: INFO os_vif [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73')
Aug 09 20:41:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No VIF found with MAC fa:16:3e:80:ec:0d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:46 user nova-compute[72620]: WARNING nova.compute.manager [req-e81e6c70-a55e-49f0-8e41-bc5092a185e7 req-a0607782-558f-404b-acd1-335ca56adba7 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state None.
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updated VIF entry in instance network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cea18cb8-3217-4930-8630-0272d5c8953b req-a2829718-fb57-41ed-ab4f-4afeb38e62a8 service nova] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Skipping network cache update for instance because it is Building. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:49 user nova-compute[72620]: WARNING nova.compute.manager [req-7d94bb76-c854-435b-9987-51c88a899f09 req-10f70c98-31b7-4e68-9945-c08a89cbaad3 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state None.
Aug 09 20:41:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:51 user nova-compute[72620]: WARNING nova.compute.manager [req-6946bbc7-1aae-43d4-9a1d-9b8bb2033e98 req-46b6e61f-b128-4999-930d-a003a8a06559 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state None.
Aug 09 20:41:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:51 user nova-compute[72620]: WARNING nova.compute.manager [req-a95e9b8a-2ac4-46d1-a85b-af4a827f892a req-aa5817a5-be50-46b1-9817-8b635e9e1961 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state building and task_state spawning.
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:51 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613712.740272, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Resumed (Lifecycle Event)
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:41:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance spawned successfully.
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:53 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613712.741036, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:41:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Started (Lifecycle Event)
Aug 09 20:41:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:41:53 user nova-compute[72620]: INFO nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Took 16.52 seconds to spawn the instance on the hypervisor.
Aug 09 20:41:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:41:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:53 user nova-compute[72620]: INFO nova.compute.manager [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Took 17.36 seconds to build instance.
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-12d9620f-958d-4bfb-bec7-cdc39e56dec4 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.535s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:41:54 user nova-compute[72620]: WARNING nova.compute.manager [req-bb49e15a-959a-44ad-b7a0-723481baa989 req-7c73eb2e-7026-4b7e-a194-6191b4afb741 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state active and task_state None.
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:41:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:41:55 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:55 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.971717834472656GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:41:55 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.195s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:58 user nova-compute[72620]: INFO nova.compute.claims [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Claim successful on node user
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:41:59 user nova-compute[72620]: INFO nova.compute.claims [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Claim successful on node user
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:41:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.policy [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c48b31f6f6b4f1d9b56f17f9fc21f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58fdcd269f2d4fd09af22fe05da41bc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:41:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Creating image(s)
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:41:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.369s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.469s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:42:00 user nova-compute[72620]: INFO nova.compute.claims [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Claim successful on node user
Aug 09 20:42:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.virt.images [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] 08dcfebe-5a68-4d8d-9276-d345dbd9aef3 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.part /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:00 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.part /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.converted" returned: 0 in 0.324s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:42:01 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Creating image(s)
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "/opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "/opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.policy [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd35d2156d9ed4cbbbaa8ae6bac1aecd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae1f11b67f948dbb2c78d07b28971c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.615s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.206s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json" returned: 0 in 0.263s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Successfully created port: 0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.228s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json" returned: 0 in 0.198s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5,backing_fmt=raw /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk 1073741824" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.245s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5,backing_fmt=raw /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk 1073741824" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.179s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:42:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 --force-share --output=json" returned: 0 in 0.205s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Cannot resize image /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lazy-loading 'migration_context' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Ensure instance console log exists: /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Cannot resize image /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'migration_context' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Ensure instance console log exists: /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:42:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Creating image(s)
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "/opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "/opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "/opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.policy [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97d6d0ff7eee41559a923dfafce80855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904bc2939444f9a9270c2b48043bc6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.192s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Successfully updated port: 0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:42:02 user nova-compute[72620]: INFO nova.compute.claims [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Claim successful on node user
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquired lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.209s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-changed-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Refreshing instance network info cache due to event network-changed-0cda2006-85da-4432-ad9d-01e159808a82. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] Acquiring lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk 1073741824" returned: 0 in 0.069s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.164s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Cannot resize image /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'migration_context' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Ensure instance console log exists: /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Successfully created port: 6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updating instance_info_cache with network_info: [{"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Releasing lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Instance network_info: |[{"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] Acquired lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Refreshing network info cache for port 0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Start _get_guest_xml network_info=[{"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:41:49Z,direct_url=<?>,disk_format='qcow2',id=08dcfebe-5a68-4d8d-9276-d345dbd9aef3,min_disk=0,min_ram=0,name='',owner='138e9969490445c5b41ef7d9c665ac75',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:41:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': '08dcfebe-5a68-4d8d-9276-d345dbd9aef3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:41:49Z,direct_url=<?>,disk_format='qcow2',id=08dcfebe-5a68-4d8d-9276-d345dbd9aef3,min_disk=0,min_ram=0,name='',owner='138e9969490445c5b41ef7d9c665ac75',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:41:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1668491987',display_name='tempest-AttachSCSIVolumeTestJSON-server-1668491987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1668491987',id=6,image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dy1pZjLXntQZgADQ4XETB7WzGTMnYUFai8MYu37YR+FMt3bl0am4ezy+RaJ3YHM1WA6EFlh1RGloHaR3l/BRpAh95vCyJutlmueEIYeEwxakixuJJQJZgPtytlhpXHg==',key_name='tempest-keypair-232616108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58fdcd269f2d4fd09af22fe05da41bc6',ramdisk_id='',reservation_id='r-s88wrxhr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1184897549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1184897549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c48b31f6f6b4f1d9b56f17f9fc21f5a',uuid=fc732850-9f28-4686-9c6a-763fc475be82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converting VIF {"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'pci_devices' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:42:03 user nova-compute[72620]:   <uuid>fc732850-9f28-4686-9c6a-763fc475be82</uuid>
Aug 09 20:42:03 user nova-compute[72620]:   <name>instance-00000006</name>
Aug 09 20:42:03 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:42:03 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:42:03 user nova-compute[72620]:   <metadata>
Aug 09 20:42:03 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:42:03 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1668491987</nova:name>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:42:03</nova:creationTime>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:42:03 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:42:03 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:owner>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:user uuid="8c48b31f6f6b4f1d9b56f17f9fc21f5a">tempest-AttachSCSIVolumeTestJSON-1184897549-project-member</nova:user>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:project uuid="58fdcd269f2d4fd09af22fe05da41bc6">tempest-AttachSCSIVolumeTestJSON-1184897549</nova:project>
Aug 09 20:42:03 user nova-compute[72620]:       </nova:owner>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:root type="image" uuid="08dcfebe-5a68-4d8d-9276-d345dbd9aef3"/>
Aug 09 20:42:03 user nova-compute[72620]:       <nova:ports>
Aug 09 20:42:03 user nova-compute[72620]:         <nova:port uuid="0cda2006-85da-4432-ad9d-01e159808a82">
Aug 09 20:42:03 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 20:42:03 user nova-compute[72620]:         </nova:port>
Aug 09 20:42:03 user nova-compute[72620]:       </nova:ports>
Aug 09 20:42:03 user nova-compute[72620]:     </nova:instance>
Aug 09 20:42:03 user nova-compute[72620]:   </metadata>
Aug 09 20:42:03 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:42:03 user nova-compute[72620]:     <system>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="serial">fc732850-9f28-4686-9c6a-763fc475be82</entry>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="uuid">fc732850-9f28-4686-9c6a-763fc475be82</entry>
Aug 09 20:42:03 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:42:03 user nova-compute[72620]:     </system>
Aug 09 20:42:03 user nova-compute[72620]:   </sysinfo>
Aug 09 20:42:03 user nova-compute[72620]:   <os>
Aug 09 20:42:03 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:42:03 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:42:03 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:42:03 user nova-compute[72620]:   </os>
Aug 09 20:42:03 user nova-compute[72620]:   <features>
Aug 09 20:42:03 user nova-compute[72620]:     <acpi/>
Aug 09 20:42:03 user nova-compute[72620]:     <apic/>
Aug 09 20:42:03 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:42:03 user nova-compute[72620]:   </features>
Aug 09 20:42:03 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:42:03 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:42:03 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:42:03 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:42:03 user nova-compute[72620]:   </clock>
Aug 09 20:42:03 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:42:03 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:42:03 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:42:03 user nova-compute[72620]:   </cpu>
Aug 09 20:42:03 user nova-compute[72620]:   <devices>
Aug 09 20:42:03 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:42:03 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:42:03 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk"/>
Aug 09 20:42:03 user nova-compute[72620]:       <target dev="sda" bus="scsi"/>
Aug 09 20:42:03 user nova-compute[72620]:       <address type="drive" controller="0" unit="0"/>
Aug 09 20:42:03 user nova-compute[72620]:     </disk>
Aug 09 20:42:03 user nova-compute[72620]:     <disk type="file" device="cdrom">
Aug 09 20:42:03 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 20:42:03 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.config"/>
Aug 09 20:42:03 user nova-compute[72620]:       <target dev="sdb" bus="scsi"/>
Aug 09 20:42:03 user nova-compute[72620]:       <address type="drive" controller="0" unit="1"/>
Aug 09 20:42:03 user nova-compute[72620]:     </disk>
Aug 09 20:42:03 user nova-compute[72620]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 09 20:42:03 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:42:03 user nova-compute[72620]:       <mac address="fa:16:3e:56:1a:09"/>
Aug 09 20:42:03 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:03 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:42:03 user nova-compute[72620]:       <target dev="tap0cda2006-85"/>
Aug 09 20:42:03 user nova-compute[72620]:     </interface>
Aug 09 20:42:03 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:42:03 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/console.log" append="off"/>
Aug 09 20:42:03 user nova-compute[72620]:     </serial>
Aug 09 20:42:03 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:42:03 user nova-compute[72620]:     <video>
Aug 09 20:42:03 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:03 user nova-compute[72620]:     </video>
Aug 09 20:42:03 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:42:03 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:42:03 user nova-compute[72620]:     </rng>
Aug 09 20:42:03 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:42:03 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:42:03 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:42:03 user nova-compute[72620]:     </memballoon>
Aug 09 20:42:03 user nova-compute[72620]:   </devices>
Aug 09 20:42:03 user nova-compute[72620]: </domain>
Aug 09 20:42:03 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1668491987',display_name='tempest-AttachSCSIVolumeTestJSON-server-1668491987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1668491987',id=6,image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dy1pZjLXntQZgADQ4XETB7WzGTMnYUFai8MYu37YR+FMt3bl0am4ezy+RaJ3YHM1WA6EFlh1RGloHaR3l/BRpAh95vCyJutlmueEIYeEwxakixuJJQJZgPtytlhpXHg==',key_name='tempest-keypair-232616108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58fdcd269f2d4fd09af22fe05da41bc6',ramdisk_id='',reservation_id='r-s88wrxhr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1184897549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1184897549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c48b31f6f6b4f1d9b56f17f9fc21f5a',uuid=fc732850-9f28-4686-9c6a-763fc475be82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converting VIF {"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG os_vif [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:42:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cda2006-85, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cda2006-85, col_values=(('external_ids', {'iface-id': '0cda2006-85da-4432-ad9d-01e159808a82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1a:09', 'vm-uuid': 'fc732850-9f28-4686-9c6a-763fc475be82'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:03 user nova-compute[72620]: INFO os_vif [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85')
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No BDM found with device name sda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No VIF found with MAC fa:16:3e:56:1a:09, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:42:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Using config drive
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:42:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Creating image(s)
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "/opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "/opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "/opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.policy [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59ca2d9d543043dc80bd990defae51a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '510fc29bc4b047ee8a40d71f256e4873', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updated VIF entry in instance network info cache for port 0cda2006-85da-4432-ad9d-01e159808a82. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updating instance_info_cache with network_info: [{"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-791a47e4-197c-4849-9984-85d4fa99e1e2 req-947ab3cb-65eb-484e-84af-3c48f0921f72 service nova] Releasing lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Creating config drive at /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.config
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe516txp6 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk 1073741824" returned: 0 in 0.099s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe516txp6" returned: 0 in 0.076s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.185s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Cannot resize image /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lazy-loading 'migration_context' on Instance uuid c16dd2cb-02ea-4947-a9ef-98fc9833614a {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Ensure instance console log exists: /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Successfully created port: 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:42:05 user nova-compute[72620]: INFO nova.compute.claims [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Claim successful on node user
Aug 09 20:42:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] No waiting events found dispatching network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:05 user nova-compute[72620]: WARNING nova.compute.manager [req-95f142bb-fe80-478e-a50e-917d74ce73eb req-21255975-ca75-48e2-8140-7b9f588bbcde service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received unexpected event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 for instance with vm_state building and task_state spawning.
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Successfully created port: aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.727s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Successfully updated port: 6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquired lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-changed-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Refreshing instance network info cache due to event network-changed-6db33a86-8c64-4493-8db3-bf494a12dbf4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] Acquiring lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:42:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Creating image(s)
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.policy [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88004f63268d4b889d25b8f51c825557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baafdb5a61a44878847326c13daa6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updating instance_info_cache with network_info: [{"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.199s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Releasing lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Instance network_info: |[{"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] Acquired lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Refreshing network info cache for port 6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Start _get_guest_xml network_info=[{"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk 1073741824" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:42:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375255164',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375255164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375255164',id=7,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGr8foXHXJLlTQaKikQDgxW00Wp4h9W/VkVWml5QvpaLivYZpYYjEEfYWfoayvMl/g7zTXMN5PWcexbyiUeH8W7LbBaWbxfS5ac52NK/H4Rya/i5hK4JochVKQRe66byg==',key_name='tempest-keypair-889436008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae1f11b67f948dbb2c78d07b28971c5',ramdisk_id='',reservation_id='r-sfjzz0gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326438208',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326438208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d35d2156d9ed4cbbbaa8ae6bac1aecd1',uuid=1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converting VIF {"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:42:07 user nova-compute[72620]:   <uuid>1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c</uuid>
Aug 09 20:42:07 user nova-compute[72620]:   <name>instance-00000007</name>
Aug 09 20:42:07 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:42:07 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:42:07 user nova-compute[72620]:   <metadata>
Aug 09 20:42:07 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:42:07 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1375255164</nova:name>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:42:06</nova:creationTime>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:42:07 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:42:07 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:owner>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:user uuid="d35d2156d9ed4cbbbaa8ae6bac1aecd1">tempest-VolumesAssistedSnapshotsTest-326438208-project-member</nova:user>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:project uuid="eae1f11b67f948dbb2c78d07b28971c5">tempest-VolumesAssistedSnapshotsTest-326438208</nova:project>
Aug 09 20:42:07 user nova-compute[72620]:       </nova:owner>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:42:07 user nova-compute[72620]:       <nova:ports>
Aug 09 20:42:07 user nova-compute[72620]:         <nova:port uuid="6db33a86-8c64-4493-8db3-bf494a12dbf4">
Aug 09 20:42:07 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:42:07 user nova-compute[72620]:         </nova:port>
Aug 09 20:42:07 user nova-compute[72620]:       </nova:ports>
Aug 09 20:42:07 user nova-compute[72620]:     </nova:instance>
Aug 09 20:42:07 user nova-compute[72620]:   </metadata>
Aug 09 20:42:07 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:42:07 user nova-compute[72620]:     <system>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="serial">1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c</entry>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="uuid">1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c</entry>
Aug 09 20:42:07 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:42:07 user nova-compute[72620]:     </system>
Aug 09 20:42:07 user nova-compute[72620]:   </sysinfo>
Aug 09 20:42:07 user nova-compute[72620]:   <os>
Aug 09 20:42:07 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:42:07 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:42:07 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:42:07 user nova-compute[72620]:   </os>
Aug 09 20:42:07 user nova-compute[72620]:   <features>
Aug 09 20:42:07 user nova-compute[72620]:     <acpi/>
Aug 09 20:42:07 user nova-compute[72620]:     <apic/>
Aug 09 20:42:07 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:42:07 user nova-compute[72620]:   </features>
Aug 09 20:42:07 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:42:07 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:42:07 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:42:07 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:42:07 user nova-compute[72620]:   </clock>
Aug 09 20:42:07 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:42:07 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:42:07 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:42:07 user nova-compute[72620]:   </cpu>
Aug 09 20:42:07 user nova-compute[72620]:   <devices>
Aug 09 20:42:07 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:42:07 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:42:07 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk"/>
Aug 09 20:42:07 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:42:07 user nova-compute[72620]:     </disk>
Aug 09 20:42:07 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:42:07 user nova-compute[72620]:       <mac address="fa:16:3e:9e:0a:a7"/>
Aug 09 20:42:07 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:07 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:42:07 user nova-compute[72620]:       <target dev="tap6db33a86-8c"/>
Aug 09 20:42:07 user nova-compute[72620]:     </interface>
Aug 09 20:42:07 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:42:07 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/console.log" append="off"/>
Aug 09 20:42:07 user nova-compute[72620]:     </serial>
Aug 09 20:42:07 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:42:07 user nova-compute[72620]:     <video>
Aug 09 20:42:07 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:07 user nova-compute[72620]:     </video>
Aug 09 20:42:07 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:42:07 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:42:07 user nova-compute[72620]:     </rng>
Aug 09 20:42:07 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:42:07 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:42:07 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:42:07 user nova-compute[72620]:     </memballoon>
Aug 09 20:42:07 user nova-compute[72620]:   </devices>
Aug 09 20:42:07 user nova-compute[72620]: </domain>
Aug 09 20:42:07 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375255164',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375255164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375255164',id=7,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGr8foXHXJLlTQaKikQDgxW00Wp4h9W/VkVWml5QvpaLivYZpYYjEEfYWfoayvMl/g7zTXMN5PWcexbyiUeH8W7LbBaWbxfS5ac52NK/H4Rya/i5hK4JochVKQRe66byg==',key_name='tempest-keypair-889436008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eae1f11b67f948dbb2c78d07b28971c5',ramdisk_id='',reservation_id='r-sfjzz0gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326438208',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326438208-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d35d2156d9ed4cbbbaa8ae6bac1aecd1',uuid=1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converting VIF {"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG os_vif [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6db33a86-8c, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6db33a86-8c, col_values=(('external_ids', {'iface-id': '6db33a86-8c64-4493-8db3-bf494a12dbf4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:0a:a7', 'vm-uuid': '1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:07 user nova-compute[72620]: INFO os_vif [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c')
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] No VIF found with MAC fa:16:3e:9e:0a:a7, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Cannot resize image /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'migration_context' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Ensure instance console log exists: /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Successfully updated port: 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquired lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updated VIF entry in instance network info cache for port 6db33a86-8c64-4493-8db3-bf494a12dbf4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updating instance_info_cache with network_info: [{"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ccc01f1a-0ff7-47bf-9792-b3771bd06381 req-5d17448f-e41c-426f-b51e-5e97bfd93ab8 service nova] Releasing lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] No waiting events found dispatching network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:07 user nova-compute[72620]: WARNING nova.compute.manager [req-d71b37ef-dfce-42fb-80a9-72c237da35df req-5857fae6-f180-45a4-a77c-2428e45f358f service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received unexpected event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 for instance with vm_state building and task_state spawning.
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613727.909794, fc732850-9f28-4686-9c6a-763fc475be82 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] VM Resumed (Lifecycle Event)
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:42:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Instance spawned successfully.
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613727.9111402, fc732850-9f28-4686-9c6a-763fc475be82 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] VM Started (Lifecycle Event)
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:08 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:08 user nova-compute[72620]: INFO nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Took 8.47 seconds to spawn the instance on the hypervisor.
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:08 user nova-compute[72620]: INFO nova.compute.manager [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Took 10.03 seconds to build instance.
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b9c7a134-1d51-47ea-ad4c-681629b4aea1 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.221s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-changed-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Refreshing instance network info cache due to event network-changed-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] Acquiring lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Successfully updated port: aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updating instance_info_cache with network_info: [{"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquired lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Successfully created port: 74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Releasing lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Instance network_info: |[{"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] Acquired lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Refreshing network info cache for port 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Start _get_guest_xml network_info=[{"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:42:08 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:08 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377301624',display_name='tempest-VolumesAdminNegativeTest-server-377301624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377301624',id=8,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEukBdZuBtrocSvFPKwMW5Z7MKopI+xCHhqSCBdFFhnvm5z3+koK/v8IIP7yDB7aSbWpYti51avv6kPsK/sYi0FI3Np01GkOJO6RQFd2zIc4gF6+QtQpVb+EEjXEU9jHHA==',key_name='tempest-keypair-2137774886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-kyftn20a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97d6d0ff7eee41559a923dfafce80855',uuid=1599e5b0-6de6-4e88-a67f-c9b4e118ebc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.objects.instance [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'pci_devices' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:42:08 user nova-compute[72620]:   <uuid>1599e5b0-6de6-4e88-a67f-c9b4e118ebc1</uuid>
Aug 09 20:42:08 user nova-compute[72620]:   <name>instance-00000008</name>
Aug 09 20:42:08 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:42:08 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:42:08 user nova-compute[72620]:   <metadata>
Aug 09 20:42:08 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:42:08 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:name>tempest-VolumesAdminNegativeTest-server-377301624</nova:name>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:42:08</nova:creationTime>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:42:08 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:42:08 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:owner>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:user uuid="97d6d0ff7eee41559a923dfafce80855">tempest-VolumesAdminNegativeTest-1213195220-project-member</nova:user>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:project uuid="8904bc2939444f9a9270c2b48043bc6e">tempest-VolumesAdminNegativeTest-1213195220</nova:project>
Aug 09 20:42:08 user nova-compute[72620]:       </nova:owner>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:42:08 user nova-compute[72620]:       <nova:ports>
Aug 09 20:42:08 user nova-compute[72620]:         <nova:port uuid="8e5c3058-1ed5-46a2-ac9c-08b6e378f85d">
Aug 09 20:42:08 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 20:42:08 user nova-compute[72620]:         </nova:port>
Aug 09 20:42:08 user nova-compute[72620]:       </nova:ports>
Aug 09 20:42:08 user nova-compute[72620]:     </nova:instance>
Aug 09 20:42:08 user nova-compute[72620]:   </metadata>
Aug 09 20:42:08 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:42:08 user nova-compute[72620]:     <system>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="serial">1599e5b0-6de6-4e88-a67f-c9b4e118ebc1</entry>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="uuid">1599e5b0-6de6-4e88-a67f-c9b4e118ebc1</entry>
Aug 09 20:42:08 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:42:08 user nova-compute[72620]:     </system>
Aug 09 20:42:08 user nova-compute[72620]:   </sysinfo>
Aug 09 20:42:08 user nova-compute[72620]:   <os>
Aug 09 20:42:08 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:42:08 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:42:08 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:42:08 user nova-compute[72620]:   </os>
Aug 09 20:42:08 user nova-compute[72620]:   <features>
Aug 09 20:42:08 user nova-compute[72620]:     <acpi/>
Aug 09 20:42:08 user nova-compute[72620]:     <apic/>
Aug 09 20:42:08 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:42:08 user nova-compute[72620]:   </features>
Aug 09 20:42:08 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:42:08 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:42:08 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:42:08 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:42:08 user nova-compute[72620]:   </clock>
Aug 09 20:42:08 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:42:08 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:42:08 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:42:08 user nova-compute[72620]:   </cpu>
Aug 09 20:42:08 user nova-compute[72620]:   <devices>
Aug 09 20:42:08 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:42:08 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:42:08 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk"/>
Aug 09 20:42:08 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:42:08 user nova-compute[72620]:     </disk>
Aug 09 20:42:08 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:42:08 user nova-compute[72620]:       <mac address="fa:16:3e:7d:f5:2b"/>
Aug 09 20:42:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:08 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:42:08 user nova-compute[72620]:       <target dev="tap8e5c3058-1e"/>
Aug 09 20:42:08 user nova-compute[72620]:     </interface>
Aug 09 20:42:08 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:42:08 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/console.log" append="off"/>
Aug 09 20:42:08 user nova-compute[72620]:     </serial>
Aug 09 20:42:08 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:42:08 user nova-compute[72620]:     <video>
Aug 09 20:42:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:08 user nova-compute[72620]:     </video>
Aug 09 20:42:08 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:42:08 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:42:08 user nova-compute[72620]:     </rng>
Aug 09 20:42:08 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:42:08 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:42:08 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:42:08 user nova-compute[72620]:     </memballoon>
Aug 09 20:42:08 user nova-compute[72620]:   </devices>
Aug 09 20:42:08 user nova-compute[72620]: </domain>
Aug 09 20:42:08 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377301624',display_name='tempest-VolumesAdminNegativeTest-server-377301624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377301624',id=8,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEukBdZuBtrocSvFPKwMW5Z7MKopI+xCHhqSCBdFFhnvm5z3+koK/v8IIP7yDB7aSbWpYti51avv6kPsK/sYi0FI3Np01GkOJO6RQFd2zIc4gF6+QtQpVb+EEjXEU9jHHA==',key_name='tempest-keypair-2137774886',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-kyftn20a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97d6d0ff7eee41559a923dfafce80855',uuid=1599e5b0-6de6-4e88-a67f-c9b4e118ebc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG os_vif [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e5c3058-1e, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e5c3058-1e, col_values=(('external_ids', {'iface-id': '8e5c3058-1ed5-46a2-ac9c-08b6e378f85d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:f5:2b', 'vm-uuid': '1599e5b0-6de6-4e88-a67f-c9b4e118ebc1'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: INFO os_vif [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e')
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No VIF found with MAC fa:16:3e:7d:f5:2b, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] No waiting events found dispatching network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:09 user nova-compute[72620]: WARNING nova.compute.manager [req-9ce66dce-6b45-4c54-8902-bc0fd0d9caf4 req-8e0d6007-ed79-4d4d-af1c-5abd0c35df6c service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received unexpected event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 for instance with vm_state building and task_state spawning.
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Updating instance_info_cache with network_info: [{"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Releasing lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Instance network_info: |[{"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Start _get_guest_xml network_info=[{"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:42:09 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:09 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348985158',display_name='tempest-VolumesActionsTest-instance-348985158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348985158',id=9,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='510fc29bc4b047ee8a40d71f256e4873',ramdisk_id='',reservation_id='r-pvcmo8v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1356058014',owner_user_name='tempest-VolumesActionsTest-1356058014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:04Z,user_data=None,user_id='59ca2d9d543043dc80bd990defae51a2',uuid=c16dd2cb-02ea-4947-a9ef-98fc9833614a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converting VIF {"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lazy-loading 'pci_devices' on Instance uuid c16dd2cb-02ea-4947-a9ef-98fc9833614a {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:42:09 user nova-compute[72620]:   <uuid>c16dd2cb-02ea-4947-a9ef-98fc9833614a</uuid>
Aug 09 20:42:09 user nova-compute[72620]:   <name>instance-00000009</name>
Aug 09 20:42:09 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:42:09 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:42:09 user nova-compute[72620]:   <metadata>
Aug 09 20:42:09 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:42:09 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:name>tempest-VolumesActionsTest-instance-348985158</nova:name>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:42:09</nova:creationTime>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:42:09 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:42:09 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:owner>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:user uuid="59ca2d9d543043dc80bd990defae51a2">tempest-VolumesActionsTest-1356058014-project-member</nova:user>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:project uuid="510fc29bc4b047ee8a40d71f256e4873">tempest-VolumesActionsTest-1356058014</nova:project>
Aug 09 20:42:09 user nova-compute[72620]:       </nova:owner>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:42:09 user nova-compute[72620]:       <nova:ports>
Aug 09 20:42:09 user nova-compute[72620]:         <nova:port uuid="aea0a3e8-f7b9-46a0-8f96-798938408c91">
Aug 09 20:42:09 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:42:09 user nova-compute[72620]:         </nova:port>
Aug 09 20:42:09 user nova-compute[72620]:       </nova:ports>
Aug 09 20:42:09 user nova-compute[72620]:     </nova:instance>
Aug 09 20:42:09 user nova-compute[72620]:   </metadata>
Aug 09 20:42:09 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:42:09 user nova-compute[72620]:     <system>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="serial">c16dd2cb-02ea-4947-a9ef-98fc9833614a</entry>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="uuid">c16dd2cb-02ea-4947-a9ef-98fc9833614a</entry>
Aug 09 20:42:09 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:42:09 user nova-compute[72620]:     </system>
Aug 09 20:42:09 user nova-compute[72620]:   </sysinfo>
Aug 09 20:42:09 user nova-compute[72620]:   <os>
Aug 09 20:42:09 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:42:09 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:42:09 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:42:09 user nova-compute[72620]:   </os>
Aug 09 20:42:09 user nova-compute[72620]:   <features>
Aug 09 20:42:09 user nova-compute[72620]:     <acpi/>
Aug 09 20:42:09 user nova-compute[72620]:     <apic/>
Aug 09 20:42:09 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:42:09 user nova-compute[72620]:   </features>
Aug 09 20:42:09 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:42:09 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:42:09 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:42:09 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:42:09 user nova-compute[72620]:   </clock>
Aug 09 20:42:09 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:42:09 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:42:09 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:42:09 user nova-compute[72620]:   </cpu>
Aug 09 20:42:09 user nova-compute[72620]:   <devices>
Aug 09 20:42:09 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:42:09 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:42:09 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk"/>
Aug 09 20:42:09 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:42:09 user nova-compute[72620]:     </disk>
Aug 09 20:42:09 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:42:09 user nova-compute[72620]:       <mac address="fa:16:3e:ce:43:56"/>
Aug 09 20:42:09 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:09 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:42:09 user nova-compute[72620]:       <target dev="tapaea0a3e8-f7"/>
Aug 09 20:42:09 user nova-compute[72620]:     </interface>
Aug 09 20:42:09 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:42:09 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/console.log" append="off"/>
Aug 09 20:42:09 user nova-compute[72620]:     </serial>
Aug 09 20:42:09 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:42:09 user nova-compute[72620]:     <video>
Aug 09 20:42:09 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:09 user nova-compute[72620]:     </video>
Aug 09 20:42:09 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:42:09 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:42:09 user nova-compute[72620]:     </rng>
Aug 09 20:42:09 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:42:09 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:42:09 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:42:09 user nova-compute[72620]:     </memballoon>
Aug 09 20:42:09 user nova-compute[72620]:   </devices>
Aug 09 20:42:09 user nova-compute[72620]: </domain>
Aug 09 20:42:09 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348985158',display_name='tempest-VolumesActionsTest-instance-348985158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348985158',id=9,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='510fc29bc4b047ee8a40d71f256e4873',ramdisk_id='',reservation_id='r-pvcmo8v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1356058014',owner_user_name='tempest-VolumesActionsTest-1356058014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:04Z,user_data=None,user_id='59ca2d9d543043dc80bd990defae51a2',uuid=c16dd2cb-02ea-4947-a9ef-98fc9833614a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converting VIF {"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG os_vif [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaea0a3e8-f7, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaea0a3e8-f7, col_values=(('external_ids', {'iface-id': 'aea0a3e8-f7b9-46a0-8f96-798938408c91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:43:56', 'vm-uuid': 'c16dd2cb-02ea-4947-a9ef-98fc9833614a'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.neutron [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updated VIF entry in instance network info cache for port 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.network.neutron [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updating instance_info_cache with network_info: [{"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:42:09 user nova-compute[72620]: INFO os_vif [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7')
Aug 09 20:42:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae445ccf-7070-4974-8a4d-eca1b7fd1514 req-94afc79b-15c3-4d99-9554-4b759376596e service nova] Releasing lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] No VIF found with MAC fa:16:3e:ce:43:56, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:42:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Successfully updated port: 74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-changed-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Refreshing instance network info cache due to event network-changed-aea0a3e8-f7b9-46a0-8f96-798938408c91. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Acquiring lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Acquired lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Refreshing network info cache for port aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Instance network_info: |[{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Start _get_guest_xml network_info=[{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:42:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'pci_devices' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:42:10 user nova-compute[72620]:   <uuid>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</uuid>
Aug 09 20:42:10 user nova-compute[72620]:   <name>instance-0000000a</name>
Aug 09 20:42:10 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:42:10 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:42:10 user nova-compute[72620]:   <metadata>
Aug 09 20:42:10 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:42:10 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:42:10</nova:creationTime>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:42:10 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:42:10 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:owner>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:42:10 user nova-compute[72620]:       </nova:owner>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:42:10 user nova-compute[72620]:       <nova:ports>
Aug 09 20:42:10 user nova-compute[72620]:         <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:42:10 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:42:10 user nova-compute[72620]:         </nova:port>
Aug 09 20:42:10 user nova-compute[72620]:       </nova:ports>
Aug 09 20:42:10 user nova-compute[72620]:     </nova:instance>
Aug 09 20:42:10 user nova-compute[72620]:   </metadata>
Aug 09 20:42:10 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:42:10 user nova-compute[72620]:     <system>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="serial">df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="uuid">df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:42:10 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:42:10 user nova-compute[72620]:     </system>
Aug 09 20:42:10 user nova-compute[72620]:   </sysinfo>
Aug 09 20:42:10 user nova-compute[72620]:   <os>
Aug 09 20:42:10 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:42:10 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:42:10 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:42:10 user nova-compute[72620]:   </os>
Aug 09 20:42:10 user nova-compute[72620]:   <features>
Aug 09 20:42:10 user nova-compute[72620]:     <acpi/>
Aug 09 20:42:10 user nova-compute[72620]:     <apic/>
Aug 09 20:42:10 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:42:10 user nova-compute[72620]:   </features>
Aug 09 20:42:10 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:42:10 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:42:10 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:42:10 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:42:10 user nova-compute[72620]:   </clock>
Aug 09 20:42:10 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:42:10 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:42:10 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:42:10 user nova-compute[72620]:   </cpu>
Aug 09 20:42:10 user nova-compute[72620]:   <devices>
Aug 09 20:42:10 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:42:10 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:42:10 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk"/>
Aug 09 20:42:10 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:42:10 user nova-compute[72620]:     </disk>
Aug 09 20:42:10 user nova-compute[72620]:     <disk type="file" device="cdrom">
Aug 09 20:42:10 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 20:42:10 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config"/>
Aug 09 20:42:10 user nova-compute[72620]:       <target dev="hda" bus="ide"/>
Aug 09 20:42:10 user nova-compute[72620]:     </disk>
Aug 09 20:42:10 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:42:10 user nova-compute[72620]:       <mac address="fa:16:3e:c3:e5:ba"/>
Aug 09 20:42:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:10 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:42:10 user nova-compute[72620]:       <target dev="tap74aae613-71"/>
Aug 09 20:42:10 user nova-compute[72620]:     </interface>
Aug 09 20:42:10 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:42:10 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log" append="off"/>
Aug 09 20:42:10 user nova-compute[72620]:     </serial>
Aug 09 20:42:10 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:42:10 user nova-compute[72620]:     <video>
Aug 09 20:42:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:42:10 user nova-compute[72620]:     </video>
Aug 09 20:42:10 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:42:10 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:42:10 user nova-compute[72620]:     </rng>
Aug 09 20:42:10 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:42:10 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:42:10 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:42:10 user nova-compute[72620]:     </memballoon>
Aug 09 20:42:10 user nova-compute[72620]:   </devices>
Aug 09 20:42:10 user nova-compute[72620]: </domain>
Aug 09 20:42:10 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG os_vif [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74aae613-71, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74aae613-71, col_values=(('external_ids', {'iface-id': '74aae613-71c2-43a4-8774-a3cc27def6e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:e5:ba', 'vm-uuid': 'df2b7ed3-d447-46bc-9ef7-2edbe34d5883'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:10 user nova-compute[72620]: INFO os_vif [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71')
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name hda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:42:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No VIF found with MAC fa:16:3e:c3:e5:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:42:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Using config drive
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Updated VIF entry in instance network info cache for port aea0a3e8-f7b9-46a0-8f96-798938408c91. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Updating instance_info_cache with network_info: [{"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Creating config drive at /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ck_wg__ {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Releasing lock "refresh_cache-c16dd2cb-02ea-4947-a9ef-98fc9833614a" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-changed-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing instance network info cache due to event network-changed-74aae613-71c2-43a4-8774-a3cc27def6e5. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing network info cache for port 74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3ck_wg__" returned: 0 in 0.075s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] No waiting events found dispatching network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:11 user nova-compute[72620]: WARNING nova.compute.manager [req-cfd135c0-ab2f-4597-bf6e-7d0922708e53 req-9fcc72ad-0a39-4502-a0dc-99672ae2050b service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received unexpected event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 for instance with vm_state building and task_state spawning.
Aug 09 20:42:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] No waiting events found dispatching network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:11 user nova-compute[72620]: WARNING nova.compute.manager [req-7634a9e9-c712-4451-96df-67e1462e921f req-b6c9cfa2-4b4e-4b2d-932d-173d5940db85 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received unexpected event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d for instance with vm_state building and task_state spawning.
Aug 09 20:42:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updated VIF entry in instance network info cache for port 74aae613-71c2-43a4-8774-a3cc27def6e5. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9bbe6f6-d38d-4fd3-8ed4-39a8002cbf55 req-7ee247b6-b7e8-4560-84f4-321389090900 service nova] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] No waiting events found dispatching network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:13 user nova-compute[72620]: WARNING nova.compute.manager [req-b8c09714-a1bc-4195-a1d4-16881cca66c1 req-aa4528e9-d380-4193-bd0a-6b9b268791b2 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received unexpected event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d for instance with vm_state building and task_state spawning.
Aug 09 20:42:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] No waiting events found dispatching network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:13 user nova-compute[72620]: WARNING nova.compute.manager [req-72aa30f0-9ee3-4251-989d-05d6ec240cc0 req-400e06a8-b588-4701-8f98-405ea6a4058d service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received unexpected event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 for instance with vm_state building and task_state spawning.
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613734.2812355, 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] VM Resumed (Lifecycle Event)
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Instance spawned successfully.
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613734.289018, 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] VM Started (Lifecycle Event)
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Took 13.32 seconds to spawn the instance on the hypervisor.
Aug 09 20:42:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:14 user nova-compute[72620]: INFO nova.compute.manager [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Took 15.75 seconds to build instance.
Aug 09 20:42:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26fb9741-f012-4ae5-98fb-658923383d5e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.009s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] No waiting events found dispatching network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:15 user nova-compute[72620]: WARNING nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received unexpected event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 for instance with vm_state building and task_state spawning.
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:15 user nova-compute[72620]: WARNING nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 for instance with vm_state building and task_state spawning.
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:42:15 user nova-compute[72620]: WARNING nova.compute.manager [req-9598d9bb-b252-4a0a-8de2-f935833d4578 req-54fa605c-b579-48e9-8173-1d6e0eb50f0c service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 for instance with vm_state building and task_state spawning.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.0774875, 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] VM Resumed (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Instance spawned successfully.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.0788252, 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] VM Started (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Took 13.84 seconds to spawn the instance on the hypervisor.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Took 17.33 seconds to build instance.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33ebbc4a-8443-43b5-98c6-c919b29cc977 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.474s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.5745437, c16dd2cb-02ea-4947-a9ef-98fc9833614a => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] VM Resumed (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Instance spawned successfully.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.576054, c16dd2cb-02ea-4947-a9ef-98fc9833614a => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] VM Started (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Took 12.99 seconds to spawn the instance on the hypervisor.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Instance spawned successfully.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.7031598, df2b7ed3-d447-46bc-9ef7-2edbe34d5883 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] VM Resumed (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Took 14.20 seconds to build instance.
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613736.7035449, df2b7ed3-d447-46bc-9ef7-2edbe34d5883 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] VM Started (Lifecycle Event)
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3a34cc83-a255-4f22-9e88-1b8c32387040 tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.367s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Took 10.53 seconds to spawn the instance on the hypervisor.
Aug 09 20:42:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:42:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:42:17 user nova-compute[72620]: INFO nova.compute.manager [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Took 11.74 seconds to build instance.
Aug 09 20:42:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3bbc22ca-0565-47c0-9d57-af62efd19dd4 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.885s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:42:41 user nova-compute[72620]: INFO nova.compute.claims [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Claim successful on node user
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:42 user nova-compute[72620]: INFO nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Booting with volume 89b6e722-df92-4b44-9417-741face61187 at /dev/vda
Aug 09 20:42:42 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:42:42 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp8fiy1l3k/privsep.sock']
Aug 09 20:42:42 user nova-compute[72620]: DEBUG nova.policy [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de4e8ecaefce4518acfdcec05cd08f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed2dfa986c1b404fbbe239a5741d45f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:42 user sudo[83809]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp8fiy1l3k/privsep.sock
Aug 09 20:42:42 user sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 09 20:42:43 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully created port: d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:43 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully created port: 4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:44 user sudo[83809]: pam_unix(sudo:session): session closed for user root
Aug 09 20:42:44 user nova-compute[72620]: INFO oslo.privsep.daemon [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Spawned new privsep daemon via rootwrap
Aug 09 20:42:44 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 09 20:42:44 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 09 20:42:44 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 09 20:42:44 user nova-compute[72620]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83828
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f4d34-0149-4ffa-ad13-e990aeff7582]: (2,) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a83b95-b6a3-4e50-936a-04546df953c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: WARNING os_brick.initiator.connectors.nvmeof [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f435eb1f-cfad-47c3-8dad-7fde239f2572]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e509de-d641-4cb9-a102-aeb9a3866ef4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7399b0-a1d5-4784-babe-21b601dd7558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:44 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:42:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba92abd-6309-4212-937e-30801ef8f3f5]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== get_connector_properties: return (2150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating existing volume attachment record: 8584c155-ad1a-4e07-a662-8ef171731cb6 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:42:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully created port: 189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully created port: 663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully created port: 4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-d9d7bc65-5b10-426a-90d6-5936196c1bc8. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b586a5c4-df63-4905-a5d4-ca593f5f6686 req-43f83a35-ac5d-44cc-8369-6d277fb3d2c1 service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:42:49 user nova-compute[72620]: INFO nova.compute.claims [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Claim successful on node user
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:42:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:42:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:42:49 user nova-compute[72620]: INFO nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Booting with volume a3b7e56f-5a59-44d9-acfa-f14550e614c9 at /dev/vda
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68c7535-f61c-4191-bd13-01bfafa64715]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867c4f7-88d9-4fc2-84de-85c00971dc9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb14bac-62ac-4dfa-bcc2-ae575e800c1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecdd658-4558-4037-80ef-a856f145e039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:50 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a080da-ed79-4024-bd41-cfeb924486f0]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating existing volume attachment record: 8c186399-d9fb-4cda-847d-fb8309101e6a {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.policy [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6eddd469e10944008e6ffdd6b42d9595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca46c4036f6a4fdd9a2eff188aad66b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-3f2ffa79-b786-478a-97c3-5018e4ed7f20. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d2f7d2a-5a07-4167-91cd-5d875aedc860 req-50622bb9-89cb-4cbe-885f-63c3780f177c service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully created port: 00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-06121608-d3a0-4a53-912a-0055f1930602. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully created port: 371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG nova.network.neutron [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a09f9ac1-6a49-4124-b668-a21d5dd1907d req-88b60274-0a1b-49d0-9f19-f462572e598f service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:42:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully created port: 10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-4565ef5a-7dac-4cab-b1db-a866e5b6b27e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:54 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-189aee1c-dfca-4faf-b429-f6295ce1aad1. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e91cd8aa-8905-4955-9c1c-7b1448f82649 req-518ac4df-93c6-4ff0-a317-9b84c768cd72 service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully created port: aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-663ab630-1868-462c-af3e-a5ebcb00f2e0. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully created port: aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c994f8a7-bf6f-4aaa-b3d8-d6785cf969fc req-1f81b43e-8764-49e0-bcca-3eaeb291e45f service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Successfully updated port: 4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: 00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: 3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-4eeb5103-c09c-4acd-b95d-5c3f78869cb0. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:42:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=6821MB free_disk=25.633541107177734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:42:59 user nova-compute[72620]: INFO nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Booting with volume 310e519b-cbf2-4955-b1af-3af2f6e973d0 at /dev/vdb
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fc732850-9f28-4686-9c6a-763fc475be82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c16dd2cb-02ea-4947-a9ef-98fc9833614a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 4ae767ef-9a76-40a8-8f7c-6f126c99af14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f5a404-28ee-4414-838c-18d77704586a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe79a68-5e18-4b39-b2a5-e5d342cc53a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36e61c-fdb7-4693-94af-d3f6f70eddf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b8e3f3-64a7-43ab-b12d-1c3e2119ede9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:42:59 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[60513eac-091c-4459-92bd-1bf98dca108b]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating existing volume attachment record: a312cc04-b575-4b25-ac4a-cafe91931719 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:42:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: 4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-3420c779-3075-4496-908d-84098c616a5c. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-4b304fe8-21fc-4fab-bd5b-856340dc5a2b. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance network_info: |[{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port 4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67010915-e4f7-4a76-824f-e0d2c7adcc4a req-f9a22f8d-c16d-4940-ae61-eeee0a68a6da service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: 371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updated VIF entry in instance network info cache for port 4eeb5103-c09c-4acd-b95d-5c3f78869cb0. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-00ba02c5-bb08-41bc-b900-860bc7f7596e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71022809-bea1-496f-8c68-9fb4dde5a2be req-f17c7d45-06f4-4958-abc1-ca99b2e1eb28 service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: 10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-371c1b3a-f7b3-4d8c-aa5e-60d060350300. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db033668-f82b-4a04-a049-997c734e28e7 req-16aa5548-8497-4333-80eb-65fd5ab2c02e service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:03 user nova-compute[72620]: INFO nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Booting with volume 3e2d921c-4401-4f77-89ff-9e718d5096bb at /dev/vdb
Aug 09 20:43:03 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0bba75-0f6b-45a7-a080-490d5fcc27ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d106a61-88de-4e57-8c55-e7019e791e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218ab6e-0913-4dda-b47d-1d7445fa0933]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c1d1b-e6d8-4bf0-b204-1a50219f7dfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:04 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d3fb79-3283-4d43-8e91-35effb388e31]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating existing volume attachment record: 2c7c9644-054e-461d-82da-661c8008aa37 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Successfully updated port: aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:43:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:43:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-10e5da83-3056-4a14-8ef9-97c9448e3756. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance network_info: |[{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updated VIF entry in instance network info cache for port 10e5da83-3056-4a14-8ef9-97c9448e3756. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-aacf977c-c650-4b08-b762-b4e3f02eb229. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updated VIF entry in instance network info cache for port aacf977c-c650-4b08-b762-b4e3f02eb229. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-aad44491-e3fa-4946-961c-0ab05aebf9e1. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:08 user nova-compute[72620]: INFO nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Booting with volume 41eb5d76-b945-4650-86cd-b0ebdb463dc9 at /dev/vdc
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updated VIF entry in instance network info cache for port aad44491-e3fa-4946-961c-0ab05aebf9e1. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918d62e-c7f3-4d69-a350-386239f7aec4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d8084a0-539d-4148-b76e-5fec84a9e5fe req-39dc9b3f-3bce-474d-8b5a-7fd5878cd49a service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57102f58-9ee9-41c9-b304-dd7e1c9761fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[65374039-273e-44e2-8e65-e4ff1563c7d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb3d4ab-edeb-4179-96a0-ce13d7b59f44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:08 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd7f56-9900-45fc-99fb-e9f0b6e750d2]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG os_brick.utils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:08 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating existing volume attachment record: 70a0aba2-f075-4ec3-8ee6-6ef287459467 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:12 user nova-compute[72620]: INFO nova.compute.manager [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Rescuing
Aug 09 20:43:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:12 user nova-compute[72620]: DEBUG nova.network.neutron [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:43:13 user nova-compute[72620]: INFO nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Booting with volume e619b635-af14-4b99-a6af-6ea1f97eceef at /dev/vdc
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bdc0d7-e590-427b-98ae-9b25e4280651]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67703626-7791-46c4-ad80-617086fa2e86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb697065-3632-4372-beba-f6fa95fc67e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ebd39-ff6b-4ecf-bfe6-aae55f1126b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:13 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f868a38-554a-463c-8e0d-767c15e47d28]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG os_brick.utils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating existing volume attachment record: bdf1e324-3260-402a-a310-efb65f65102d {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:13 user nova-compute[72620]: WARNING nova.compute.manager [req-fa338fa4-8415-4bfc-a756-75c260e27d2a req-8cf6a3b7-21bc-40b7-bd58-1147725fb80f service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state active and task_state rescuing.
Aug 09 20:43:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance destroyed successfully.
Aug 09 20:43:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Attempting rescue
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:43:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Creating image(s)
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.155s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue" returned: 0 in 0.056s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start _get_guest_xml network_info=[{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:4d:e8:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'numa_topology' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355704383',display_name='tempest-ServerRescueNegativeTestJSON-server-355704383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355704383',id=2,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-msw2d2fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:43Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fd67d539-7cdf-4abc-a32e-d98f6be67e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:4d:e8:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:4d:e8:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:43:14 user nova-compute[72620]:   <uuid>fd67d539-7cdf-4abc-a32e-d98f6be67e1b</uuid>
Aug 09 20:43:14 user nova-compute[72620]:   <name>instance-00000002</name>
Aug 09 20:43:14 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:43:14 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:43:14 user nova-compute[72620]:   <metadata>
Aug 09 20:43:14 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:43:14 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-355704383</nova:name>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:43:14</nova:creationTime>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:43:14 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:43:14 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:owner>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:43:14 user nova-compute[72620]:       </nova:owner>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:43:14 user nova-compute[72620]:       <nova:ports>
Aug 09 20:43:14 user nova-compute[72620]:         <nova:port uuid="46aca639-e25b-4982-962c-e0999eab9bc5">
Aug 09 20:43:14 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:43:14 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:14 user nova-compute[72620]:       </nova:ports>
Aug 09 20:43:14 user nova-compute[72620]:     </nova:instance>
Aug 09 20:43:14 user nova-compute[72620]:   </metadata>
Aug 09 20:43:14 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:43:14 user nova-compute[72620]:     <system>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="serial">fd67d539-7cdf-4abc-a32e-d98f6be67e1b</entry>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="uuid">fd67d539-7cdf-4abc-a32e-d98f6be67e1b</entry>
Aug 09 20:43:14 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:43:14 user nova-compute[72620]:     </system>
Aug 09 20:43:14 user nova-compute[72620]:   </sysinfo>
Aug 09 20:43:14 user nova-compute[72620]:   <os>
Aug 09 20:43:14 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:43:14 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:43:14 user nova-compute[72620]:   </os>
Aug 09 20:43:14 user nova-compute[72620]:   <features>
Aug 09 20:43:14 user nova-compute[72620]:     <acpi/>
Aug 09 20:43:14 user nova-compute[72620]:     <apic/>
Aug 09 20:43:14 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:43:14 user nova-compute[72620]:   </features>
Aug 09 20:43:14 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:43:14 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:43:14 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:43:14 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:43:14 user nova-compute[72620]:   </clock>
Aug 09 20:43:14 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:43:14 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:43:14 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:43:14 user nova-compute[72620]:   </cpu>
Aug 09 20:43:14 user nova-compute[72620]:   <devices>
Aug 09 20:43:14 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:43:14 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:43:14 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue"/>
Aug 09 20:43:14 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:43:14 user nova-compute[72620]:     </disk>
Aug 09 20:43:14 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:43:14 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:43:14 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk"/>
Aug 09 20:43:14 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:43:14 user nova-compute[72620]:     </disk>
Aug 09 20:43:14 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:14 user nova-compute[72620]:       <mac address="fa:16:3e:4d:e8:4e"/>
Aug 09 20:43:14 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:14 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:14 user nova-compute[72620]:       <target dev="tap46aca639-e2"/>
Aug 09 20:43:14 user nova-compute[72620]:     </interface>
Aug 09 20:43:14 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:43:14 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/console.log" append="off"/>
Aug 09 20:43:14 user nova-compute[72620]:     </serial>
Aug 09 20:43:14 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:43:14 user nova-compute[72620]:     <video>
Aug 09 20:43:14 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:14 user nova-compute[72620]:     </video>
Aug 09 20:43:14 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:43:14 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:43:14 user nova-compute[72620]:     </rng>
Aug 09 20:43:14 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:43:14 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:43:14 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:43:14 user nova-compute[72620]:     </memballoon>
Aug 09 20:43:14 user nova-compute[72620]:   </devices>
Aug 09 20:43:14 user nova-compute[72620]: </domain>
Aug 09 20:43:14 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:43:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance destroyed successfully.
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:4d:e8:4e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:16 user nova-compute[72620]: WARNING nova.compute.manager [req-1c824737-c304-4cdc-b0c7-129980503e6a req-892d402d-df53-45f9-8d96-3676ead77792 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state active and task_state rescuing.
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lazy-loading 'flavor' on Instance uuid fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:17 user nova-compute[72620]: INFO nova.compute.manager [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Attaching volume 8612d2f4-09bb-4619-b60a-ae67f3968495 to /dev/vdb
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.utils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6340fb1a-3ce7-44e8-aa2f-67f90d88a214]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9832201c-924e-467f-bcb0-0022540ae274]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3610801e-4fcb-46f9-95c9-11095357bdd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a0076-7280-44b3-a964-d16567c3fc2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:17 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6633ede-e382-4dfb-b794-b45e4875296e]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG os_brick.utils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:17 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Updating existing volume attachment record: 6a99e7fc-c51a-4dbb-9933-978474793b8f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:43:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Creating image(s)
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Ensure instance console log exists: /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Start _get_guest_xml network_info=[{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAyPFfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae767ef-9a76-40a8-8f7c-6f126c99af14', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3b7e56f-5a59-44d9-acfa-f14550e614c9', 'serial': 'a3b7e56f-5a59-44d9-acfa-f14550e614c9'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '8c186399-d9fb-4cda-847d-fb8309101e6a', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMwRaIlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae767ef-9a76-40a8-8f7c-6f126c99af14', 'attached_at': '', 'detached_at': '', 'volume_id': '310e519b-cbf2-4955-b1af-3af2f6e973d0', 'serial': '310e519b-cbf2-4955-b1af-3af2f6e973d0'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'a312cc04-b575-4b25-ac4a-cafe91931719', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcTinSVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ae767ef-9a76-40a8-8f7c-6f126c99af14', 'attached_at': '', 'detached_at': '', 'volume_id': '41eb5d76-b945-4650-86cd-b0ebdb463dc9', 'serial': '41eb5d76-b945-4650-86cd-b0ebdb463dc9'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '70a0aba2-f075-4ec3-8ee6-6ef287459467', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connector [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Factory for ISCSI on None {{(pid=72620) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAyPFfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:18 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7b2964-abe7-45d4-9ae5-79746d0dd129]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:18 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state active and task_state rescuing.
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING nova.compute.manager [req-c78ca0f1-c169-4424-b335-cf838fa0425a req-6e157782-c5ea-4db3-a5b4-8211cb24cf3d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state active and task_state rescuing.
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[38959e06-cfaa-4e89-b71b-0e443d675af2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9] added
Aug 09 20:43:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46861c-b4f2-4f2d-8da7-5e3e43736e40]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168c2ff-0c6d-4f31-8a02-9377f50eea78]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VAyPFfkJ {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VAyPFfkJ" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca3906c-563f-43bc-ab31-ccb2dafd026b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VAyPFfkJ'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bafa8-06c3-451a-89a1-48ac8d9118f5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[435eb936-9e98-45a6-832e-eca0de8c0fe1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:43:18 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:43:18 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:43:18 user nova-compute[72620]: 
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0f5511-6cfc-426c-b6d4-48d68862c8aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260]
Aug 09 20:43:18 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c764a5-b63a-4248-abbb-1057fbc1309a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a3709-ca99-453e-984d-05a3dffd150c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf70dc-bba5-4b0f-a209-66c90bc037c4]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAyPFfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for fd67d539-7cdf-4abc-a32e-d98f6be67e1b due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613798.4986782, fd67d539-7cdf-4abc-a32e-d98f6be67e1b => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:18 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] VM Resumed (Lifecycle Event)
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-af974296-c2bd-4081-9832-5afe935ae6e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:18 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613798.499905, fd67d539-7cdf-4abc-a32e-d98f6be67e1b => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:18 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] VM Started (Lifecycle Event)
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:18 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26539383631336133', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383631336133', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMwRaIlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:19 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:19 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:19 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c288973-67ac-4de0-8f20-33c510f80e55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:19 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05c10f9-e76e-48d9-9dba-64b6a108a034]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0] added
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a99726-3423-4942-85d9-52a1030dd1ea]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9869f1-189c-4ff0-b8ab-df3bc1697b68]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMwRaIlU {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bMwRaIlU" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d039592-153e-4049-9b6a-96fc5d7e0ecb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bMwRaIlU'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c48d693-09de-4713-a8ae-37e2d4f30d85]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1480410-c7ae-4f9f-affc-c3f48100a96c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ec74b-e539-4df8-b58b-1d929067d449]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260]
Aug 09 20:43:19 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506df29-c13a-49dd-a742-30dbe19d5939]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35cb1d-c2db-4aef-8cff-65567ed6597d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff9fc65-df4c-471c-a1a6-3638a82c611a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-changed-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Refreshing instance network info cache due to event network-changed-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Refreshing network info cache for port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updated VIF entry in instance network info cache for port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce06631e-0d7f-4f73-81fa-2db6c64f992e req-49474938-ea56-4819-b2a6-6023827fe41c service nova] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMwRaIlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23661346565383663', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661346565383663', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcTinSVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:20 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a3ac24-f3e6-4a3f-b384-e6a088433eb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:20 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2cd5c-b623-425a-af83-16b17d6ec7e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9] added
Aug 09 20:43:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[943e2083-9eb9-4427-826f-72fbba3251d1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bfc7c3-eed7-4001-9660-c7fb6f9087ab]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcTinSVU {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcTinSVU" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb2548-cc4d-415b-8bf7-0ed26b72bf45]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcTinSVU'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[36332606-2ee9-470f-b60b-7e8fda7549e7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cadc3b-96ba-49c0-992a-695b9622861f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:20 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:20 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f788ab5-5974-4c78-a78c-22aee2b532a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260]
Aug 09 20:43:21 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e4bf4-eb2c-4580-b457-9c7967c36edf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bec507-6a24-4398-9301-1afc1058eb54]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[79147ffb-0ccc-43f8-addf-55f04cf851bc]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcTinSVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23836633839333962', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836633839333962', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae767ef-9a76-40a8-8f7c-6f126c99af14 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:43:22 user nova-compute[72620]:   <uuid>4ae767ef-9a76-40a8-8f7c-6f126c99af14</uuid>
Aug 09 20:43:22 user nova-compute[72620]:   <name>instance-0000000c</name>
Aug 09 20:43:22 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:43:22 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:43:22 user nova-compute[72620]:   <metadata>
Aug 09 20:43:22 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:43:22 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:name>tempest-device-tagging-server-158600537</nova:name>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:43:18</nova:creationTime>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:43:22 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:43:22 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:owner>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:user uuid="6eddd469e10944008e6ffdd6b42d9595">tempest-TaggedBootDevicesTest-367732195-project-member</nova:user>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:project uuid="ca46c4036f6a4fdd9a2eff188aad66b3">tempest-TaggedBootDevicesTest-367732195</nova:project>
Aug 09 20:43:22 user nova-compute[72620]:       </nova:owner>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:43:22 user nova-compute[72620]:       <nova:ports>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="00ba02c5-bb08-41bc-b900-860bc7f7596e">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="3420c779-3075-4496-908d-84098c616a5c">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="4b304fe8-21fc-4fab-bd5b-856340dc5a2b">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="371c1b3a-f7b3-4d8c-aa5e-60d060350300">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="10e5da83-3056-4a14-8ef9-97c9448e3756">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.86" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="aacf977c-c650-4b08-b762-b4e3f02eb229">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:         <nova:port uuid="aad44491-e3fa-4946-961c-0ab05aebf9e1">
Aug 09 20:43:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 20:43:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:22 user nova-compute[72620]:       </nova:ports>
Aug 09 20:43:22 user nova-compute[72620]:     </nova:instance>
Aug 09 20:43:22 user nova-compute[72620]:   </metadata>
Aug 09 20:43:22 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:43:22 user nova-compute[72620]:     <system>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="serial">4ae767ef-9a76-40a8-8f7c-6f126c99af14</entry>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="uuid">4ae767ef-9a76-40a8-8f7c-6f126c99af14</entry>
Aug 09 20:43:22 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:43:22 user nova-compute[72620]:     </system>
Aug 09 20:43:22 user nova-compute[72620]:   </sysinfo>
Aug 09 20:43:22 user nova-compute[72620]:   <os>
Aug 09 20:43:22 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:43:22 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:43:22 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:43:22 user nova-compute[72620]:   </os>
Aug 09 20:43:22 user nova-compute[72620]:   <features>
Aug 09 20:43:22 user nova-compute[72620]:     <acpi/>
Aug 09 20:43:22 user nova-compute[72620]:     <apic/>
Aug 09 20:43:22 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:43:22 user nova-compute[72620]:   </features>
Aug 09 20:43:22 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:43:22 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:43:22 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:43:22 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:43:22 user nova-compute[72620]:   </clock>
Aug 09 20:43:22 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:43:22 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:43:22 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:43:22 user nova-compute[72620]:   </cpu>
Aug 09 20:43:22 user nova-compute[72620]:   <devices>
Aug 09 20:43:22 user nova-compute[72620]:     <disk type="file" device="cdrom">
Aug 09 20:43:22 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 20:43:22 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/disk.config"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="hda" bus="ide"/>
Aug 09 20:43:22 user nova-compute[72620]:     </disk>
Aug 09 20:43:22 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:22 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:22 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <serial>a3b7e56f-5a59-44d9-acfa-f14550e614c9</serial>
Aug 09 20:43:22 user nova-compute[72620]:     </disk>
Aug 09 20:43:22 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:22 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:22 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <serial>310e519b-cbf2-4955-b1af-3af2f6e973d0</serial>
Aug 09 20:43:22 user nova-compute[72620]:     </disk>
Aug 09 20:43:22 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:22 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:22 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="vdc" bus="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <serial>41eb5d76-b945-4650-86cd-b0ebdb463dc9</serial>
Aug 09 20:43:22 user nova-compute[72620]:     </disk>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:07:57:4d"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tap00ba02c5-bb"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:86:14:c8"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tap3420c779-30"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:6b:6b:fe"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tap4b304fe8-21"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:5b:ca:6d"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tap371c1b3a-f7"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:ea:67:ff"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tap10e5da83-30"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:da:2b:cd"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tapaacf977c-c6"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:22 user nova-compute[72620]:       <mac address="fa:16:3e:f2:11:eb"/>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:22 user nova-compute[72620]:       <target dev="tapaad44491-e3"/>
Aug 09 20:43:22 user nova-compute[72620]:     </interface>
Aug 09 20:43:22 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:43:22 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/console.log" append="off"/>
Aug 09 20:43:22 user nova-compute[72620]:     </serial>
Aug 09 20:43:22 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:43:22 user nova-compute[72620]:     <video>
Aug 09 20:43:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:22 user nova-compute[72620]:     </video>
Aug 09 20:43:22 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:43:22 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:43:22 user nova-compute[72620]:     </rng>
Aug 09 20:43:22 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:43:22 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:43:22 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:43:22 user nova-compute[72620]:     </memballoon>
Aug 09 20:43:22 user nova-compute[72620]:   </devices>
Aug 09 20:43:22 user nova-compute[72620]: </domain>
Aug 09 20:43:22 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00ba02c5-bb, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00ba02c5-bb, col_values=(('external_ids', {'iface-id': '00ba02c5-bb08-41bc-b900-860bc7f7596e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:57:4d', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3420c779-30, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3420c779-30, col_values=(('external_ids', {'iface-id': '3420c779-3075-4496-908d-84098c616a5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:14:c8', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b304fe8-21, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4b304fe8-21, col_values=(('external_ids', {'iface-id': '4b304fe8-21fc-4fab-bd5b-856340dc5a2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:6b:fe', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap371c1b3a-f7, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap371c1b3a-f7, col_values=(('external_ids', {'iface-id': '371c1b3a-f7b3-4d8c-aa5e-60d060350300', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:ca:6d', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e5da83-30, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10e5da83-30, col_values=(('external_ids', {'iface-id': '10e5da83-3056-4a14-8ef9-97c9448e3756', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:67:ff', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaacf977c-c6, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaacf977c-c6, col_values=(('external_ids', {'iface-id': 'aacf977c-c650-4b08-b762-b4e3f02eb229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:2b:cd', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaad44491-e3, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaad44491-e3, col_values=(('external_ids', {'iface-id': 'aad44491-e3fa-4946-961c-0ab05aebf9e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:11:eb', 'vm-uuid': '4ae767ef-9a76-40a8-8f7c-6f126c99af14'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:22 user nova-compute[72620]: INFO os_vif [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3')
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] No BDM found with device name hda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] No VIF found with MAC fa:16:3e:07:57:4d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] No VIF found with MAC fa:16:3e:ea:67:ff, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Using config drive
Aug 09 20:43:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Creating config drive at /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/disk.config
Aug 09 20:43:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvhrjt_wb {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvhrjt_wb" returned: 0 in 0.068s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:43:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Creating image(s)
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Ensure instance console log exists: /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Start _get_guest_xml network_info=[{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVAwFcXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe', 'attached_at': '', 'detached_at': '', 'volume_id': '89b6e722-df92-4b44-9417-741face61187', 'serial': '89b6e722-df92-4b44-9417-741face61187'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '8584c155-ad1a-4e07-a662-8ef171731cb6', 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHfEepjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe', 'attached_at': '', 'detached_at': '', 'volume_id': '3e2d921c-4401-4f77-89ff-9e718d5096bb', 'serial': '3e2d921c-4401-4f77-89ff-9e718d5096bb'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '2c7c9644-054e-461d-82da-661c8008aa37', 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDTNjoXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe', 'attached_at': '', 'detached_at': '', 'volume_id': 'e619b635-af14-4b99-a6af-6ea1f97eceef', 'serial': 'e619b635-af14-4b99-a6af-6ea1f97eceef'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': 'bdf1e324-3260-402a-a310-efb65f65102d', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:43:23 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:23 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVAwFcXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:23 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8891ab57-3e3f-4f38-bd36-245e23002203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:23 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75fbad-0c0a-4849-b174-119ace912a11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187] added
Aug 09 20:43:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c15564-984e-45d0-9bff-e756fe2a1ecf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c494ba9d-31a2-4ced-be18-4a6786e52414]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVAwFcXz {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVAwFcXz" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[719cea97-b140-4898-9d0a-5eb2fc75b796]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVAwFcXz'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9eebad-7063-4139-92a0-a6f58d6df0d0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75dc5a1-cb36-4766-b5ed-8e9ff8af16ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a6abb-78cb-4b07-9514-45c30f936fd3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260]
Aug 09 20:43:24 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bc1e4c-f48d-4f1f-ab98-e5fc82c99099]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3817938c-c66a-4517-86e1-3bb033dfdbc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[578d41ba-0432-42e8-a819-b1847e0dc755]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVAwFcXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:25 user nova-compute[72620]: WARNING nova.compute.manager [req-034796f3-eb97-4d57-b891-4eedf97744c6 req-ed2930b9-7227-4232-8287-ce47dd0d0d0d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e for instance with vm_state building and task_state spawning.
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26231343734303464', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231343734303464', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHfEepjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:25 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a67fe4-a317-4a57-99b0-e62c1ab21a84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:25 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74067642-9423-41d5-983f-cef5babf6440]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb] added
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[740497ba-4084-4b41-b5bd-94d05541cd41]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4e68e-fcee-4466-a08a-98daabfc65f5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHfEepjm {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IHfEepjm" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec53404-4fbd-426f-8a33-59d941c66c11]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IHfEepjm'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2537b0bb-b890-4de1-aaca-d2f8d49654ed]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69a1d86-c983-42b1-8d72-1f9f266da1c7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --login" returned: 0 in 0.142s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ec730-2850-46ac-a11b-6627906e3428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260]
Aug 09 20:43:25 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[126db4ea-9034-4f02-a43d-0c76199597fc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d678b-f6fb-490a-b17a-9dea0a9178f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:25 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19cbfee-7f08-4620-bfa4-04d3f68638b8]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHfEepjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23663626266613233', 'path': '/dev/sdf'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663626266613233', 'path': '/dev/sdf'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDTNjoXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:26 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedf37b-5bc6-4ef1-bc03-d6c00b98c457]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:26 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[96268ae1-1590-4a33-8d1a-484113fcceb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef] added
Aug 09 20:43:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53e17ea-5a6a-437f-a52c-32169176b4a2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[212005aa-c214-48cd-9ca3-e5dc1fc99306]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDTNjoXy {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDTNjoXy" returned: 0 in 0.041s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5b882-38ab-4f8c-b7a7-eeb493abd1f7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDTNjoXy'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6717956-c3be-4e11-9477-639183793bb0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5505274-6826-4e40-afc8-fac2bb63c61f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:27 user nova-compute[72620]: WARNING nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e for instance with vm_state building and task_state spawning.
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:27 user nova-compute[72620]: WARNING nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c for instance with vm_state building and task_state spawning.
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:27 user nova-compute[72620]: WARNING nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c for instance with vm_state building and task_state spawning.
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:27 user nova-compute[72620]: WARNING nova.compute.manager [req-12db42ff-2119-4401-bcd5-8f3a17978c1b req-ef0c6ddb-546a-4d1d-a57b-1be45c40fa88 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b for instance with vm_state building and task_state spawning.
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e7200e-6d14-465b-a0ae-5b177682e8a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260]
Aug 09 20:43:27 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82ad50f-8fb1-4609-baa8-d3bc4160508c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d97722-9870-40d3-b955-06aee3571bdd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:27 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ad95f56c-452b-4cf5-9f8e-6582da3a3771 req-e30cdcd3-27d4-45f2-8b17-b1cbb5429d2c service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 for instance with vm_state building and task_state spawning.
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea0c5a7-c2a3-4890-88c3-540f44d2331a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDTNjoXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23939306261613036', 'path': '/dev/sdg'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939306261613036', 'path': '/dev/sdg'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ab68ec3-a65c-490b-9cc0-23d20f358dbe {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:43:28 user nova-compute[72620]:   <uuid>2ab68ec3-a65c-490b-9cc0-23d20f358dbe</uuid>
Aug 09 20:43:28 user nova-compute[72620]:   <name>instance-0000000b</name>
Aug 09 20:43:28 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:43:28 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:43:28 user nova-compute[72620]:   <metadata>
Aug 09 20:43:28 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:43:28 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:name>tempest-device-tagging-server-733495258</nova:name>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:43:23</nova:creationTime>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:43:28 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:43:28 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:owner>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:user uuid="de4e8ecaefce4518acfdcec05cd08f6b">tempest-TaggedBootDevicesTest_v242-2010398884-project-member</nova:user>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:project uuid="ed2dfa986c1b404fbbe239a5741d45f3">tempest-TaggedBootDevicesTest_v242-2010398884</nova:project>
Aug 09 20:43:28 user nova-compute[72620]:       </nova:owner>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:43:28 user nova-compute[72620]:       <nova:ports>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="d9d7bc65-5b10-426a-90d6-5936196c1bc8">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="3f2ffa79-b786-478a-97c3-5018e4ed7f20">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="06121608-d3a0-4a53-912a-0055f1930602">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="4565ef5a-7dac-4cab-b1db-a866e5b6b27e">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.115" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="189aee1c-dfca-4faf-b429-f6295ce1aad1">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="663ab630-1868-462c-af3e-a5ebcb00f2e0">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:         <nova:port uuid="4eeb5103-c09c-4acd-b95d-5c3f78869cb0">
Aug 09 20:43:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 09 20:43:28 user nova-compute[72620]:         </nova:port>
Aug 09 20:43:28 user nova-compute[72620]:       </nova:ports>
Aug 09 20:43:28 user nova-compute[72620]:     </nova:instance>
Aug 09 20:43:28 user nova-compute[72620]:   </metadata>
Aug 09 20:43:28 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:43:28 user nova-compute[72620]:     <system>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="serial">2ab68ec3-a65c-490b-9cc0-23d20f358dbe</entry>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="uuid">2ab68ec3-a65c-490b-9cc0-23d20f358dbe</entry>
Aug 09 20:43:28 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:43:28 user nova-compute[72620]:     </system>
Aug 09 20:43:28 user nova-compute[72620]:   </sysinfo>
Aug 09 20:43:28 user nova-compute[72620]:   <os>
Aug 09 20:43:28 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:43:28 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:43:28 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:43:28 user nova-compute[72620]:   </os>
Aug 09 20:43:28 user nova-compute[72620]:   <features>
Aug 09 20:43:28 user nova-compute[72620]:     <acpi/>
Aug 09 20:43:28 user nova-compute[72620]:     <apic/>
Aug 09 20:43:28 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:43:28 user nova-compute[72620]:   </features>
Aug 09 20:43:28 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:43:28 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:43:28 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:43:28 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:43:28 user nova-compute[72620]:   </clock>
Aug 09 20:43:28 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:43:28 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:43:28 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:43:28 user nova-compute[72620]:   </cpu>
Aug 09 20:43:28 user nova-compute[72620]:   <devices>
Aug 09 20:43:28 user nova-compute[72620]:     <disk type="file" device="cdrom">
Aug 09 20:43:28 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none"/>
Aug 09 20:43:28 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/disk.config"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="hda" bus="ide"/>
Aug 09 20:43:28 user nova-compute[72620]:     </disk>
Aug 09 20:43:28 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:28 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:28 user nova-compute[72620]:       <source dev="/dev/sde"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <serial>89b6e722-df92-4b44-9417-741face61187</serial>
Aug 09 20:43:28 user nova-compute[72620]:     </disk>
Aug 09 20:43:28 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:28 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:28 user nova-compute[72620]:       <source dev="/dev/sdf"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <serial>3e2d921c-4401-4f77-89ff-9e718d5096bb</serial>
Aug 09 20:43:28 user nova-compute[72620]:     </disk>
Aug 09 20:43:28 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:43:28 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:28 user nova-compute[72620]:       <source dev="/dev/sdg"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="vdc" bus="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <serial>e619b635-af14-4b99-a6af-6ea1f97eceef</serial>
Aug 09 20:43:28 user nova-compute[72620]:     </disk>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:c2:9b:17"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tapd9d7bc65-5b"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:7d:67:85"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap3f2ffa79-b7"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:ec:4f:87"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap06121608-d3"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:db:ee:54"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap4565ef5a-7d"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:f5:c0:24"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap189aee1c-df"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:d5:f3:55"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap663ab630-18"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:43:28 user nova-compute[72620]:       <mac address="fa:16:3e:8e:2e:da"/>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:43:28 user nova-compute[72620]:       <target dev="tap4eeb5103-c0"/>
Aug 09 20:43:28 user nova-compute[72620]:     </interface>
Aug 09 20:43:28 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:43:28 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/console.log" append="off"/>
Aug 09 20:43:28 user nova-compute[72620]:     </serial>
Aug 09 20:43:28 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:43:28 user nova-compute[72620]:     <video>
Aug 09 20:43:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:43:28 user nova-compute[72620]:     </video>
Aug 09 20:43:28 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:43:28 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:43:28 user nova-compute[72620]:     </rng>
Aug 09 20:43:28 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:43:28 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:43:28 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:43:28 user nova-compute[72620]:     </memballoon>
Aug 09 20:43:28 user nova-compute[72620]:   </devices>
Aug 09 20:43:28 user nova-compute[72620]: </domain>
Aug 09 20:43:28 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9d7bc65-5b, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9d7bc65-5b, col_values=(('external_ids', {'iface-id': 'd9d7bc65-5b10-426a-90d6-5936196c1bc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:9b:17', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2ffa79-b7, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f2ffa79-b7, col_values=(('external_ids', {'iface-id': '3f2ffa79-b786-478a-97c3-5018e4ed7f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:67:85', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06121608-d3, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06121608-d3, col_values=(('external_ids', {'iface-id': '06121608-d3a0-4a53-912a-0055f1930602', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:4f:87', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4565ef5a-7d, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4565ef5a-7d, col_values=(('external_ids', {'iface-id': '4565ef5a-7dac-4cab-b1db-a866e5b6b27e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:ee:54', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189aee1c-df, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap189aee1c-df, col_values=(('external_ids', {'iface-id': '189aee1c-dfca-4faf-b429-f6295ce1aad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c0:24', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap663ab630-18, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap663ab630-18, col_values=(('external_ids', {'iface-id': '663ab630-1868-462c-af3e-a5ebcb00f2e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f3:55', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtovGNHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b00a3-8664-44a7-9aca-15a428f9cc24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:43:28 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc8952a-8dc7-467e-b8a8-57b36e38b056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4eeb5103-c0, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4eeb5103-c0, col_values=(('external_ids', {'iface-id': '4eeb5103-c09c-4acd-b95d-5c3f78869cb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:2e:da', 'vm-uuid': '2ab68ec3-a65c-490b-9cc0-23d20f358dbe'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495] added
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb84b3a-30af-4cb5-ba3b-5f4e1c9b9b13]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2bb2fd-e3b5-4184-890f-325813d625e4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtovGNHD {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:28 user nova-compute[72620]: INFO os_vif [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0')
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtovGNHD" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[033a142c-7622-4fdb-9e2d-c77a5e3dfedb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtovGNHD'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f68760-6ab2-45d0-9615-e95d2e312ef9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf9e25-b469-4738-a8c5-c6f17c439398]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] No BDM found with device name hda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] No VIF found with MAC fa:16:3e:c2:9b:17, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] No VIF found with MAC fa:16:3e:f5:c0:24, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Using config drive
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37e99b-0388-459d-ba23-2f942b6bd753]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260]
Aug 09 20:43:28 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4121854-d059-41e5-adf2-33d90d90bb60]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60bbb6a-59ba-47a4-8581-b7b0ccaeed9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:28 user nova-compute[72620]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)
Aug 09 20:43:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ee164-0622-4d7c-9003-d5351629aa53]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtovGNHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Creating config drive at /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/disk.config
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprza8mrpx {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprza8mrpx" returned: 0 in 0.075s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:29 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b for instance with vm_state building and task_state spawning.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:29 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 for instance with vm_state building and task_state spawning.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-changed-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing instance network info cache due to event network-changed-6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.network.neutron [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613809.571332, 4ae767ef-9a76-40a8-8f7c-6f126c99af14 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] VM Resumed (Lifecycle Event)
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:29 user nova-compute[72620]: WARNING nova.compute.manager [req-9e44337d-94e6-4ad1-8a85-e27d74572de6 req-ad136853-73e5-4101-9f20-e0ad4a93b66d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 for instance with vm_state building and task_state spawning.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance spawned successfully.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613809.5849142, 4ae767ef-9a76-40a8-8f7c-6f126c99af14 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] VM Started (Lifecycle Event)
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Took 11.80 seconds to spawn the instance on the hypervisor.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] instance snapshotting
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Beginning live snapshot process
Aug 09 20:43:29 user nova-compute[72620]: INFO nova.compute.manager [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Took 40.69 seconds to build instance.
Aug 09 20:43:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cbc31d-514c-4dee-94ff-031aedf57424 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.790s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23630336533666136', 'path': '/dev/sdh'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630336533666136', 'path': '/dev/sdh'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lazy-loading 'flavor' on Instance uuid fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:43:30 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:43:30 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:43:30 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:43:30 user nova-compute[72620]:   <serial>8612d2f4-09bb-4619-b60a-ae67f3968495</serial>
Aug 09 20:43:30 user nova-compute[72620]: </disk>
Aug 09 20:43:30 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updated VIF entry in instance network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:30 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 for instance with vm_state building and task_state spawning.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:30 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 for instance with vm_state building and task_state spawning.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:30 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 for instance with vm_state building and task_state spawning.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:30 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 for instance with vm_state building and task_state spawning.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:30 user nova-compute[72620]: WARNING nova.compute.manager [req-89e74176-52ee-4ef3-a95e-74872ff178f6 req-f9569ef5-43f0-45c7-a99f-0f1ada20e863 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 for instance with vm_state building and task_state spawning.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca.delta 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca.delta 1073741824" returned: 0 in 0.048s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72620) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 09 20:43:30 user nova-compute[72620]: INFO nova.virt.libvirt.host [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] UEFI support detected
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] No VIF found with MAC fa:16:3e:04:1c:7e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e504fb5-5c34-4baf-9895-45ebad290581 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.856s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:31 user nova-compute[72620]: INFO nova.compute.manager [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Terminating instance
Aug 09 20:43:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:31 user nova-compute[72620]: WARNING nova.compute.manager [req-40fd6d4d-95a3-4f4e-a9f0-1b0e6a3629e5 req-d1b52501-b736-4305-8a25-1d3d11da56dc service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 for instance with vm_state building and task_state spawning.
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] COPY block job progress, current cursor: 24379392 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Instance destroyed successfully.
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lazy-loading 'resources' on Instance uuid fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2109987802',display_name='tempest-DeleteServersTestJSON-server-2109987802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2109987802',id=3,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='961e3f5814f24c00a788497482bc5a7c',ramdisk_id='',reservation_id='r-50phryer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2023065016',owner_user_name='tempest-DeleteServersTestJSON-2023065016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:41:43Z,user_data=None,user_id='3fb47bde8c4e4dcca773c5de60a54b70',uuid=fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converting VIF {"id": "79856a57-2542-4788-a2ea-98324847e670", "address": "fa:16:3e:04:1c:7e", "network": {"id": "dd5521dc-d059-48b5-ad13-284a0774385c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-217874082-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "961e3f5814f24c00a788497482bc5a7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79856a57-25", "ovs_interfaceid": "79856a57-2542-4788-a2ea-98324847e670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG os_vif [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79856a57-25, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:32 user nova-compute[72620]: WARNING nova.compute.manager [req-106eac1b-0a6d-4b3b-9ea7-8ae42fe12c97 req-8162c66e-2807-4783-8608-c174a3eb2d1a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 for instance with vm_state building and task_state spawning.
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:32 user nova-compute[72620]: INFO os_vif [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:1c:7e,bridge_name='br-int',has_traffic_filtering=True,id=79856a57-2542-4788-a2ea-98324847e670,network=Network(dd5521dc-d059-48b5-ad13-284a0774385c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79856a57-25')
Aug 09 20:43:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtovGNHD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:32 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:43:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:43:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f90101-44bd-4d11-923b-fd2be69e1f93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f049d-cda6-4b83-a662-45476bdcc8cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:43:33 user nova-compute[72620]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 (non-flash)
Aug 09 20:43:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5032d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495'): ({'sdh'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Removing single pathed devices sdh {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74de732-e1b3-4354-9bc4-d878f5b1f243]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca.delta /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db26e7-e342-42cd-ba7e-526597ecea18]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Flushing IO for device /dev/sdh {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5825ec9f-c33d-4240-8eed-82a53ad034b2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.057s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dec39f-f103-4af8-a238-2e1cfeee63e6]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e78f033-c9bd-4bde-aca9-bdc73318dfee]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --logout" returned: 0 in 0.153s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1061e28d-46a9-4749-ba88-ae8f0825ff5c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260]
Aug 09 20:43:33 user nova-compute[72620]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495, portal: 172.16.0.220,3260] successful.
Aug 09 20:43:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8612d2f4-09bb-4619-b60a-ae67f3968495 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.072s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1076ba2-3315-4218-b9f3-18f9fb751a67]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.618s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] <== disconnect_volume: return (623ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:43:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Deleting instance files /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc_del
Aug 09 20:43:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Deletion of /opt/stack/data/nova/instances/fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc_del complete
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca.delta /opt/stack/data/nova/instances/snapshots/tmpra_pe5r0/71b517279e3c489094a12dece2fab2ca" returned: 0 in 0.542s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Snapshot extracted, beginning image upload
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:33 user nova-compute[72620]: WARNING nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 for instance with vm_state building and task_state spawning.
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-unplugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] No waiting events found dispatching network-vif-unplugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-unplugged-79856a57-2542-4788-a2ea-98324847e670 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Acquiring lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] No waiting events found dispatching network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:33 user nova-compute[72620]: WARNING nova.compute.manager [req-feedc273-5b4e-4196-a80e-9a7ba8b1e0a0 req-e3fe4055-1843-4226-b517-78df7ced02cf service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received unexpected event network-vif-plugged-79856a57-2542-4788-a2ea-98324847e670 for instance with vm_state active and task_state deleting.
Aug 09 20:43:33 user nova-compute[72620]: INFO nova.compute.manager [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Took 2.42 seconds to destroy the instance on the hypervisor.
Aug 09 20:43:33 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:34 user nova-compute[72620]: WARNING nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 for instance with vm_state building and task_state spawning.
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:34 user nova-compute[72620]: WARNING nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 for instance with vm_state building and task_state spawning.
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:34 user nova-compute[72620]: WARNING nova.compute.manager [req-310fcee4-1c76-49cf-9aac-f2bcefdf0627 req-bab66929-b07d-4e28-a9f0-88d58011aad1 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 for instance with vm_state building and task_state spawning.
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:35 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Took 1.44 seconds to deallocate network for instance.
Aug 09 20:43:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:35 user nova-compute[72620]: WARNING nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 for instance with vm_state building and task_state spawning.
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:35 user nova-compute[72620]: WARNING nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 for instance with vm_state building and task_state spawning.
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:35 user nova-compute[72620]: WARNING nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 for instance with vm_state building and task_state spawning.
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:35 user nova-compute[72620]: WARNING nova.compute.manager [req-178461f5-49cd-48b2-a7de-d81e9119a0bf req-24d757d4-8d6b-4df0-b8b4-ae9915610450 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 for instance with vm_state building and task_state spawning.
Aug 09 20:43:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:36 user nova-compute[72620]: WARNING nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e for instance with vm_state building and task_state spawning.
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Received event network-vif-deleted-79856a57-2542-4788-a2ea-98324847e670 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:36 user nova-compute[72620]: WARNING nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e for instance with vm_state building and task_state spawning.
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:36 user nova-compute[72620]: WARNING nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 for instance with vm_state building and task_state spawning.
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:43:36 user nova-compute[72620]: WARNING nova.compute.manager [req-98073d88-a2ec-47b3-aafa-ccae64bcdd9b req-5e221f15-04f2-494e-a454-26f7650c76b6 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 for instance with vm_state building and task_state spawning.
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613817.0413644, 2ab68ec3-a65c-490b-9cc0-23d20f358dbe => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] VM Resumed (Lifecycle Event)
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance spawned successfully.
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613817.046682, 2ab68ec3-a65c-490b-9cc0-23d20f358dbe => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] VM Started (Lifecycle Event)
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Snapshot image upload complete
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-e2116fa4-af30-44c6-aa31-ac274cdb0dce tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Took 7.40 seconds to snapshot the instance on the hypervisor.
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Took 13.39 seconds to spawn the instance on the hypervisor.
Aug 09 20:43:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Took 55.93 seconds to build instance.
Aug 09 20:43:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-36e66db4-7223-4df3-9052-4fb40daeef41 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.090s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:37 user nova-compute[72620]: INFO nova.compute.manager [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Took 2.78 seconds to detach 1 volumes for instance.
Aug 09 20:43:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:43:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:43:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:38 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Deleted allocations for instance fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc
Aug 09 20:43:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cc27fd99-88a1-4318-8fec-7f8d8a3ecf99 tempest-DeleteServersTestJSON-2023065016 tempest-DeleteServersTestJSON-2023065016-project-member] Lock "fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.301s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:47 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613812.668115, fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:43:47 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] VM Stopped (Lifecycle Event)
Aug 09 20:43:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-52d0fa21-a42e-4ea1-bca1-3a2ff7d610cb None None] [instance: fa0742da-d0c4-4a8a-9888-a3ac2bfbebbc] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:43:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-changed-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Refreshing instance network info cache due to event network-changed-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] Acquiring lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] Acquired lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Refreshing network info cache for port 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-changed-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Refreshing instance network info cache due to event network-changed-0cda2006-85da-4432-ad9d-01e159808a82. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] Acquiring lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] Acquired lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Refreshing network info cache for port 0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-changed-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Refreshing instance network info cache due to event network-changed-6db33a86-8c64-4493-8db3-bf494a12dbf4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] Acquiring lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] Acquired lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Refreshing network info cache for port 6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.objects.instance [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lazy-loading 'flavor' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updated VIF entry in instance network info cache for port 8e5c3058-1ed5-46a2-ac9c-08b6e378f85d. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updating instance_info_cache with network_info: [{"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9590767f-9084-4f41-8fa1-cf4376ecb80c req-aa02525b-a1cc-42ac-b1ef-61f19fee0068 service nova] Releasing lock "refresh_cache-1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:50 user nova-compute[72620]: INFO nova.compute.manager [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Attaching volume 0d88288e-badc-4fba-bed1-1be1963edc18 to /dev/vdb
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updated VIF entry in instance network info cache for port 0cda2006-85da-4432-ad9d-01e159808a82. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updating instance_info_cache with network_info: [{"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9a50bca-4704-4b95-9d3c-e6a78a964313 req-9d68536c-03e9-4906-88dc-4f6e876a8657 service nova] Releasing lock "refresh_cache-fc732850-9f28-4686-9c6a-763fc475be82" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce36a309-1c59-4ab8-867a-61050b3be07a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa87b5d-41ab-4b7b-ba64-cff5f5689eba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f5cea-add0-4a8e-92e8-daf9f182a82c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[789aaafe-5459-42e8-88d3-937c03d0ac3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:50 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[45393587-0ad4-41e8-9f21-591b8354398d]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:50 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updating existing volume attachment record: 4b0023aa-88b4-4e79-8df9-af35038fd16f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updated VIF entry in instance network info cache for port 6db33a86-8c64-4493-8db3-bf494a12dbf4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updating instance_info_cache with network_info: [{"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fa714b0-b328-4755-a6e3-9c163ce90c6f req-0b3ab032-d508-4a7a-8dc2-e246b844b8fa service nova] Releasing lock "refresh_cache-1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'flavor' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:54 user nova-compute[72620]: INFO nova.compute.manager [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Attaching volume 7cbc8ebc-7e5d-4992-820f-10ac10989c1f to /dev/vdb
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.utils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d373c01-fa45-4378-bf8e-f4f9705eb01b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9007e5f5-2c22-4630-bc3f-018094b667e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a1bd63-eb7f-4a0c-9003-6cd6f867b4a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0887e72-1381-417f-a691-1cd77fdef6f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:54 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9f3d16-b0e1-4fc8-a04e-4a1f3c49633c]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG os_brick.utils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updating existing volume attachment record: 17a9f8d5-5b4e-49df-924c-a100d495a6f5 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'flavor' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:55 user nova-compute[72620]: INFO nova.compute.manager [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Attaching volume 064535f0-7044-4eb2-b749-48a0f5e6d7da to /dev/sdc
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.utils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d9f265-4923-4243-96dd-b393c2c0d9f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1c6282-c803-46c1-b529-d4fd2630532e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[41918513-3af3-4905-bf03-3b4d864f9ce4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e0074-ba29-40da-9bdb-2cd46931c154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:43:55 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:43:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b628d4a8-44b5-4c43-b05d-df74c040fa4f]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG os_brick.utils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:43:55 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updating existing volume attachment record: 8e551119-bbd8-4ef9-b752-1edf80ec632b {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:43:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-changed-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing instance network info cache due to event network-changed-74aae613-71c2-43a4-8774-a3cc27def6e5. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing network info cache for port 74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updated VIF entry in instance network info cache for port 74aae613-71c2-43a4-8774-a3cc27def6e5. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f3309b70-54db-4eb2-b410-e08d448dad8e req-83b1589d-0606-4f8e-9802-2032c8e13ec2 service nova] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'pci_requests' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:43:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:43:58 user nova-compute[72620]: DEBUG nova.policy [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88004f63268d4b889d25b8f51c825557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3baafdb5a61a44878847326c13daa6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:43:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Successfully created port: f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Successfully updated port: f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-changed-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing instance network info cache due to event network-changed-f1805ee7-2afc-4dde-8fb3-96a57c8b560c. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Refreshing network info cache for port f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG os_vif [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1805ee7-2a, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1805ee7-2a, col_values=(('external_ids', {'iface-id': 'f1805ee7-2afc-4dde-8fb3-96a57c8b560c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:a3:4f', 'vm-uuid': 'df2b7ed3-d447-46bc-9ef7-2edbe34d5883'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:43:59 user nova-compute[72620]: INFO os_vif [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a')
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] attach device xml: <interface type="ethernet">
Aug 09 20:43:59 user nova-compute[72620]:   <mac address="fa:16:3e:b2:a3:4f"/>
Aug 09 20:43:59 user nova-compute[72620]:   <model type="virtio"/>
Aug 09 20:43:59 user nova-compute[72620]:   <mtu size="1442"/>
Aug 09 20:43:59 user nova-compute[72620]:   <target dev="tapf1805ee7-2a"/>
Aug 09 20:43:59 user nova-compute[72620]: </interface>
Aug 09 20:43:59 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:43:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.network.neutron [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updated VIF entry in instance network info cache for port f1805ee7-2afc-4dde-8fb3-96a57c8b560c. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.network.neutron [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-827a3cf3-6bbe-4193-8188-6f274d13e79a req-680aad6d-bfc8-4df7-bb53-8fdc17bc5be8 service nova] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:00 user nova-compute[72620]: WARNING nova.compute.manager [req-67d2f252-6a1e-45cc-aef8-dfe789c0d816 req-b8e6786b-8fda-4dc1-9fe4-09ad1bfbaca5 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c for instance with vm_state active and task_state None.
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name hda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No VIF found with MAC fa:16:3e:c3:e5:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:00 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:00</nova:creationTime>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:00 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:00 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:00 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:00 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:00 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:00 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:00 user nova-compute[72620]:     <nova:port uuid="f1805ee7-2afc-4dde-8fb3-96a57c8b560c">
Aug 09 20:44:00 user nova-compute[72620]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 09 20:44:00 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:00 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:00 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:00 user nova-compute[72620]:  {{(pid=72620) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2d16ea5c-d016-4907-8112-d6848666522a tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.318s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:02 user nova-compute[72620]: WARNING nova.compute.manager [req-43a0f5da-b033-4cd0-9706-98d02a51dae9 req-13e7b861-ca46-4a03-ba66-6c4db1848c05 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c for instance with vm_state active and task_state None.
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXTqRAfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:03 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:03 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:03 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3abc25-3ac5-4607-8ea3-7f196a72c875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:44:03 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52487446-d58f-4fce-9d19-2607b74e32f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18] added
Aug 09 20:44:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b3311a-1408-46a0-ac97-3087541820f2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7481e94-1082-4342-8b14-4fce14ea6284]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXTqRAfr {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXTqRAfr" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2dd3aa-6ab4-498d-bc8c-252b676d0e98]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yXTqRAfr'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[27afb74f-4ce0-426b-b4b0-d363a97fe21c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac759bde-40d3-489a-99d4-05bf94a6614a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:03 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ffc633-d393-4240-82b9-eba5350ee374]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260]
Aug 09 20:44:04 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:04 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[78980934-256c-4926-a624-d8d34ead4618]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.122s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1ff3eb-c26b-47b6-97b4-c9c26499b8a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:04 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:04 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[88445c64-400b-4455-b649-fa4d8816c03d]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXTqRAfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=6572MB free_disk=25.587177276611328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:04 user nova-compute[72620]: INFO nova.compute.manager [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Attaching volume 8adda2b8-96fd-492b-a407-da38eb852535 to /dev/vdb
Aug 09 20:44:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fc732850-9f28-4686-9c6a-763fc475be82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c16dd2cb-02ea-4947-a9ef-98fc9833614a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 4ae767ef-9a76-40a8-8f7c-6f126c99af14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.utils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.490s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23232326639613263', 'path': '/dev/sdh'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232326639613263', 'path': '/dev/sdh'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdaf76c-17f4-496c-85c1-12082137f67c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.objects.instance [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lazy-loading 'flavor' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c2c6ee-b3c8-4703-b293-e1cf30a6b862]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[44172bc1-2605-46be-a12b-cb845f0b23ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c71815d-6df9-4e20-9f9a-25062ff329db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] attach device xml: <disk type="block" device="disk">
Aug 09 20:44:05 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:05 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:05 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:05 user nova-compute[72620]:   <serial>0d88288e-badc-4fba-bed1-1be1963edc18</serial>
Aug 09 20:44:05 user nova-compute[72620]: </disk>
Aug 09 20:44:05 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:44:05 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96c7f8-8e3d-475e-9b07-9210e63a169e]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.utils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating existing volume attachment record: 1fd0eb05-37a6-4d25-815e-972ac92042a0 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.607s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuTOGRPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:05 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9742ac4e-24c8-4956-afd4-d75ccc0d1220]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:44:05 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7276c-ad33-4f1c-b70e-c0c149c854af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da] added
Aug 09 20:44:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[50020e11-e0cc-435d-a0bf-0a9ec96f936a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccee104-f384-4977-b6da-e6f762b598f1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZuTOGRPh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZuTOGRPh" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf1222d-d343-452f-a7cd-fa6297473ace]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZuTOGRPh'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bf5d15-297f-4d18-be25-2dfba673307a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d4091e-6b18-47cd-9464-0b5462ac375d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:05 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] No VIF found with MAC fa:16:3e:9e:0a:a7, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57f9011-42b5-4098-8245-f5a452c5db8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260]
Aug 09 20:44:05 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55f5bb-7736-4418-9dd8-0fc73f786660]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dab0b1-a552-426f-bb2a-221d56d75cf2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:06 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[81901019-bd07-4840-939b-53e7fd12fb60]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuTOGRPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-40a97abd-69f4-46a2-8af0-a7d3d3402340 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.387s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] volume_snapshot_create: create_info: {'snapshot_id': '23412d88-982f-4521-863c-bafeec95e331', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72620) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] snap xml: <domainsnapshot>
Aug 09 20:44:06 user nova-compute[72620]:   <disks>
Aug 09 20:44:06 user nova-compute[72620]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 09 20:44:06 user nova-compute[72620]:       <source file="/dev/new_file"/>
Aug 09 20:44:06 user nova-compute[72620]:     </disk>
Aug 09 20:44:06 user nova-compute[72620]:     <disk name="vda" snapshot="no"/>
Aug 09 20:44:06 user nova-compute[72620]:   </disks>
Aug 09 20:44:06 user nova-compute[72620]: </domainsnapshot>
Aug 09 20:44:06 user nova-compute[72620]:  {{(pid=72620) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lazy-loading 'system_metadata' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     rv = execute(f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     six.reraise(c, e, tb)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     raise value
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     rv = meth(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     self._volume_snapshot_create(context, instance, guest,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     rv = execute(f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     six.reraise(c, e, tb)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     raise value
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     rv = meth(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] 
Aug 09 20:44:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a8ed54e4-6ad1-4206-9143-309b8996c1d1 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] volume_snapshot_delete: delete_info: {'volume_id': '0d88288e-badc-4fba-bed1-1be1963edc18'} {{(pid=72620) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [None req-a8ed54e4-6ad1-4206-9143-309b8996c1d1 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c]     if delete_info['type'] != 'qcow2':
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] KeyError: 'type'
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] 
Aug 09 20:44:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 23412d88-982f-4521-863c-bafeec95e331 could not be found.
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise value
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 23412d88-982f-4521-863c-bafeec95e331 could not be found. (HTTP 404) (Request-ID: req-f39f22fb-5a26-44c6-8a15-5364add4c328)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 23412d88-982f-4521-863c-bafeec95e331 could not be found.
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server [None req-d537ab39-026b-4e31-a80b-d17aff44d314 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 193, in doit
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 132, in execute
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise value
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/eventlet/tpool.py", line 86, in tworker
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver [None req-a8ed54e4-6ad1-4206-9143-309b8996c1d1 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2f4d5da0-3888-4d2a-be30-f7b621be72b3)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 223, in post
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 09 20:44:06 user nova-compute[72620]: ERROR nova.virt.libvirt.driver 
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server [None req-a8ed54e4-6ad1-4206-9143-309b8996c1d1 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Exception during message handling: KeyError: 'type'
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 09 20:44:06 user nova-compute[72620]: ERROR oslo_messaging.rpc.server 
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:07 user nova-compute[72620]: INFO nova.compute.manager [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Detaching volume 0d88288e-badc-4fba-bed1-1be1963edc18
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23264313266623035', 'path': '/dev/sdi'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264313266623035', 'path': '/dev/sdi'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'flavor' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:44:07 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:07 user nova-compute[72620]:   <source dev="/dev/sdi"/>
Aug 09 20:44:07 user nova-compute[72620]:   <target dev="sdc" bus="scsi"/>
Aug 09 20:44:07 user nova-compute[72620]:   <serial>064535f0-7044-4eb2-b749-48a0f5e6d7da</serial>
Aug 09 20:44:07 user nova-compute[72620]:   <address type="drive" controller="0" unit="2"/>
Aug 09 20:44:07 user nova-compute[72620]: </disk>
Aug 09 20:44:07 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:44:07 user nova-compute[72620]: INFO nova.virt.block_device [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Attempting to driver detach volume 0d88288e-badc-4fba-bed1-1be1963edc18 from mountpoint /dev/vdb
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Attempting to detach device vdb from instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:07 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:07 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:07 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:07 user nova-compute[72620]:   <serial>0d88288e-badc-4fba-bed1-1be1963edc18</serial>
Aug 09 20:44:07 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:44:07 user nova-compute[72620]: </disk>
Aug 09 20:44:07 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Successfully detached device vdb from instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c from the persistent domain config.
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:07 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:07 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:07 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:07 user nova-compute[72620]:   <serial>0d88288e-badc-4fba-bed1-1be1963edc18</serial>
Aug 09 20:44:07 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:44:07 user nova-compute[72620]: </disk>
Aug 09 20:44:07 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No BDM found with device name sda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] No VIF found with MAC fa:16:3e:56:1a:09, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CskJWAlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:07 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:07 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:07 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeef270c-1ae8-4bfb-8a34-2bcc057613e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:44:07 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2fb7ec-e99c-490a-8aa4-5ebbefafd64b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f] added
Aug 09 20:44:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-966b2fe2-cc47-463a-8b83-c12079b0920e tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.561s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62d4afb-8f2d-4d1c-b7d1-463867f4efbf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691613847.7935832, 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:44:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Successfully detached device vdb from instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c from the live domain config.
Aug 09 20:44:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXTqRAfr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:07 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9058e0a7-3f54-480b-9f00-24d10ffcd6f2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CskJWAlu {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CskJWAlu" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffd128a-4375-4628-a64c-0a4cab031a5d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CskJWAlu'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[702164b5-4b75-4690-a3eb-a9c1d5b2643f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b36bda-73f4-42c3-83ca-d968e0402aed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:07 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e801a-7529-4d63-a480-238333fc7801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260]
Aug 09 20:44:07 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[decb4765-f3e7-4604-80e0-a4912ff102fb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f7cc7-46ef-4c0f-bfe9-807a9e43f87f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:08 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e885ad-5d44-4cdf-82d3-95903f959dd0]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:08 user nova-compute[72620]: INFO nova.compute.manager [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Detaching volume 064535f0-7044-4eb2-b749-48a0f5e6d7da
Aug 09 20:44:09 user nova-compute[72620]: INFO nova.virt.block_device [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Attempting to driver detach volume 064535f0-7044-4eb2-b749-48a0f5e6d7da from mountpoint /dev/sdc
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Attempting to detach device sdc from instance fc732850-9f28-4686-9c6a-763fc475be82 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:09 user nova-compute[72620]:   <source dev="/dev/sdi"/>
Aug 09 20:44:09 user nova-compute[72620]:   <target dev="sdc" bus="scsi"/>
Aug 09 20:44:09 user nova-compute[72620]:   <serial>064535f0-7044-4eb2-b749-48a0f5e6d7da</serial>
Aug 09 20:44:09 user nova-compute[72620]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 20:44:09 user nova-compute[72620]: </disk>
Aug 09 20:44:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Successfully detached device sdc from instance fc732850-9f28-4686-9c6a-763fc475be82 from the persistent domain config.
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance fc732850-9f28-4686-9c6a-763fc475be82 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:09 user nova-compute[72620]:   <source dev="/dev/sdi"/>
Aug 09 20:44:09 user nova-compute[72620]:   <target dev="sdc" bus="scsi"/>
Aug 09 20:44:09 user nova-compute[72620]:   <serial>064535f0-7044-4eb2-b749-48a0f5e6d7da</serial>
Aug 09 20:44:09 user nova-compute[72620]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 09 20:44:09 user nova-compute[72620]: </disk>
Aug 09 20:44:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CskJWAlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23066336439313532', 'path': '/dev/sdj'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066336439313532', 'path': '/dev/sdj'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.292s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'flavor' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b26e5b-6681-4271-9985-92c60b4d1fc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:44:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:09 user nova-compute[72620]:   <source dev="/dev/sdj"/>
Aug 09 20:44:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:09 user nova-compute[72620]:   <serial>7cbc8ebc-7e5d-4992-820f-10ac10989c1f</serial>
Aug 09 20:44:09 user nova-compute[72620]: </disk>
Aug 09 20:44:09 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb09f68e-b479-4c5d-b057-5564bdd5ef23]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30559fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18'): ({'sdh'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Removing single pathed devices sdh {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7815f25-7298-4f62-b985-e7a895b68c7b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[562c139c-3fc6-4d16-930f-d9878355bb85]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Flushing IO for device /dev/sdh {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab946ce-1d38-497f-b8b2-2b7241873926]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[664685c4-d9fa-4570-89ab-9b1968142cc4]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc350195-88d8-4de7-8e09-8f9e09844f5b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d0ecf5-d567-4004-9cac-25d73f5b1a80]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260]
Aug 09 20:44:09 user nova-compute[72620]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d88288e-badc-4fba-bed1-1be1963edc18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a3be8-ca0a-4ebc-9aa7-2fa266ebeb57]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] <== disconnect_volume: return (1635ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691613849.4398894, fc732850-9f28-4686-9c6a-763fc475be82 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:44:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Successfully detached device sdc from instance fc732850-9f28-4686-9c6a-763fc475be82 from the live domain config.
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZuTOGRPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:09 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa976d55-e37f-4784-ba9b-871542cfd7b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3dbdd6-4004-4e41-b153-abab85cce63e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:09 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d282a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da'): ({'sdi'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Removing single pathed devices sdi {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50cda2-0d6c-419f-89fc-c8d80530ffee]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40dfa76-df4f-4176-9594-3fad5eb60dc4]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Flushing IO for device /dev/sdi {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c85667-d429-45fd-9e4c-7ac31e4b3ed1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.050s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[630edb41-8cc8-4f31-964a-db208aab2ee5]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] SCSI volumes sdi have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c77fb7-26bc-4aaf-a826-e0c8a3ba4d6e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb152d08-b700-450c-a02b-42c5e6f8fada]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260]
Aug 09 20:44:09 user nova-compute[72620]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:064535f0-7044-4eb2-b749-48a0f5e6d7da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf480a1-0331-4cfb-ba5d-8466858e7b9f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] <== disconnect_volume: return (345ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No VIF found with MAC fa:16:3e:7d:f5:2b, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lazy-loading 'flavor' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77797374-b45e-4aa5-ba20-75e2b2593ea6 tempest-VolumesAssistedSnapshotsTest-1034928660 tempest-VolumesAssistedSnapshotsTest-1034928660-project-admin] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.323s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dd463d7e-bffa-49c5-b3b9-e03a6c11a4b5 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.771s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'flavor' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-49cc9ba6-a36e-484f-859d-33d7a46e0049 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.881s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:11 user nova-compute[72620]: INFO nova.compute.manager [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Detaching volume 7cbc8ebc-7e5d-4992-820f-10ac10989c1f
Aug 09 20:44:11 user nova-compute[72620]: INFO nova.virt.block_device [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Attempting to driver detach volume 7cbc8ebc-7e5d-4992-820f-10ac10989c1f from mountpoint /dev/vdb
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Attempting to detach device vdb from instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:11 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:11 user nova-compute[72620]:   <source dev="/dev/sdj"/>
Aug 09 20:44:11 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:11 user nova-compute[72620]:   <serial>7cbc8ebc-7e5d-4992-820f-10ac10989c1f</serial>
Aug 09 20:44:11 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:44:11 user nova-compute[72620]: </disk>
Aug 09 20:44:11 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully detached device vdb from instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 from the persistent domain config.
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:11 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:11 user nova-compute[72620]:   <source dev="/dev/sdj"/>
Aug 09 20:44:11 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:11 user nova-compute[72620]:   <serial>7cbc8ebc-7e5d-4992-820f-10ac10989c1f</serial>
Aug 09 20:44:11 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:44:11 user nova-compute[72620]: </disk>
Aug 09 20:44:11 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:11 user nova-compute[72620]: INFO nova.compute.manager [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Terminating instance
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691613851.9810984, 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:44:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully detached device vdb from instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 from the live domain config.
Aug 09 20:44:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CskJWAlu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:11 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ba32c-f7ca-4e24-88a3-8ec896096e3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c5c07-16be-446f-a2ad-88f05fddf391]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:12 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5075c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f'): ({'sdj'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Removing single pathed devices sdj {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d25ac98-3e5a-4998-9172-e57183e66298]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b32078-eaf5-4ee6-96d9-560233afbf92]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Flushing IO for device /dev/sdj {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[09137e53-b14a-41e6-b067-ca857de68b28]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba70574-476f-4ac2-a953-cebbca34d539]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] SCSI volumes sdj have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[273bc2db-8609-4ec1-9e0a-f2fdf5781613]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[282e172b-16e1-4510-92c9-050780a4dee9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260]
Aug 09 20:44:12 user nova-compute[72620]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cbc8ebc-7e5d-4992-820f-10ac10989c1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b7c2a6-bd63-40c3-bf72-ae83507538f6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] <== disconnect_volume: return (377ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-unplugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] No waiting events found dispatching network-vif-unplugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-3366d1ce-635a-49b7-8ce4-6c04972aba62 req-e054d52b-c518-4079-8687-90fdbec7b69b service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-unplugged-0cda2006-85da-4432-ad9d-01e159808a82 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Instance destroyed successfully.
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.objects.instance [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lazy-loading 'resources' on Instance uuid fc732850-9f28-4686-9c6a-763fc475be82 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1668491987',display_name='tempest-AttachSCSIVolumeTestJSON-server-1668491987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1668491987',id=6,image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7Dy1pZjLXntQZgADQ4XETB7WzGTMnYUFai8MYu37YR+FMt3bl0am4ezy+RaJ3YHM1WA6EFlh1RGloHaR3l/BRpAh95vCyJutlmueEIYeEwxakixuJJQJZgPtytlhpXHg==',key_name='tempest-keypair-232616108',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58fdcd269f2d4fd09af22fe05da41bc6',ramdisk_id='',reservation_id='r-s88wrxhr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='08dcfebe-5a68-4d8d-9276-d345dbd9aef3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1184897549',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1184897549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c48b31f6f6b4f1d9b56f17f9fc21f5a',uuid=fc732850-9f28-4686-9c6a-763fc475be82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converting VIF {"id": "0cda2006-85da-4432-ad9d-01e159808a82", "address": "fa:16:3e:56:1a:09", "network": {"id": "1c4c02eb-807a-430b-bddd-93763585b7e1", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-603404186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58fdcd269f2d4fd09af22fe05da41bc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cda2006-85", "ovs_interfaceid": "0cda2006-85da-4432-ad9d-01e159808a82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG os_vif [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cda2006-85, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:12 user nova-compute[72620]: INFO os_vif [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1a:09,bridge_name='br-int',has_traffic_filtering=True,id=0cda2006-85da-4432-ad9d-01e159808a82,network=Network(1c4c02eb-807a-430b-bddd-93763585b7e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cda2006-85')
Aug 09 20:44:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Deleting instance files /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82_del
Aug 09 20:44:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Deletion of /opt/stack/data/nova/instances/fc732850-9f28-4686-9c6a-763fc475be82_del complete
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:12 user nova-compute[72620]: INFO nova.compute.manager [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Terminating instance
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:44:12 user nova-compute[72620]: INFO nova.compute.manager [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 20:44:12 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'flavor' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-unplugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] No waiting events found dispatching network-vif-unplugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-edfa1f47-e176-41e7-9d42-ed76bb260973 req-aefc30de-be8e-4a29-8aac-e6ebb3bac9ce service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-unplugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4207628f-286f-463c-9f12-7f44dae52a70 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.021s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Instance destroyed successfully.
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lazy-loading 'resources' on Instance uuid c16dd2cb-02ea-4947-a9ef-98fc9833614a {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:42:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-348985158',display_name='tempest-VolumesActionsTest-instance-348985158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-348985158',id=9,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='510fc29bc4b047ee8a40d71f256e4873',ramdisk_id='',reservation_id='r-pvcmo8v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1356058014',owner_user_name='tempest-VolumesActionsTest-1356058014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data=None,user_id='59ca2d9d543043dc80bd990defae51a2',uuid=c16dd2cb-02ea-4947-a9ef-98fc9833614a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converting VIF {"id": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "address": "fa:16:3e:ce:43:56", "network": {"id": "65074ca0-8f52-4bce-bf56-e73013155e66", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1537970977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "510fc29bc4b047ee8a40d71f256e4873", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaea0a3e8-f7", "ovs_interfaceid": "aea0a3e8-f7b9-46a0-8f96-798938408c91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG os_vif [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaea0a3e8-f7, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:13 user nova-compute[72620]: INFO os_vif [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:43:56,bridge_name='br-int',has_traffic_filtering=True,id=aea0a3e8-f7b9-46a0-8f96-798938408c91,network=Network(65074ca0-8f52-4bce-bf56-e73013155e66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaea0a3e8-f7')
Aug 09 20:44:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Deleting instance files /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a_del
Aug 09 20:44:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Deletion of /opt/stack/data/nova/instances/c16dd2cb-02ea-4947-a9ef-98fc9833614a_del complete
Aug 09 20:44:13 user nova-compute[72620]: INFO nova.compute.manager [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 09 20:44:13 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:44:13 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:14 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Took 1.45 seconds to deallocate network for instance.
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] Acquiring lock "fc732850-9f28-4686-9c6a-763fc475be82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] Lock "fc732850-9f28-4686-9c6a-763fc475be82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] No waiting events found dispatching network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:14 user nova-compute[72620]: WARNING nova.compute.manager [req-b7a5b079-481d-44c7-8275-276c9a4dfaa7 req-b2ff2b86-d2c7-4962-819d-0ede8b66c239 service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received unexpected event network-vif-plugged-0cda2006-85da-4432-ad9d-01e159808a82 for instance with vm_state deleted and task_state None.
Aug 09 20:44:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:14 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:14 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Deleted allocations for instance fc732850-9f28-4686-9c6a-763fc475be82
Aug 09 20:44:14 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Took 1.36 seconds to deallocate network for instance.
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5a42f8ca-17c5-42f7-a6e5-4b1e2e210850 tempest-AttachSCSIVolumeTestJSON-1184897549 tempest-AttachSCSIVolumeTestJSON-1184897549-project-member] Lock "fc732850-9f28-4686-9c6a-763fc475be82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.088s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:15 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Deleted allocations for instance c16dd2cb-02ea-4947-a9ef-98fc9833614a
Aug 09 20:44:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] Acquiring lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] No waiting events found dispatching network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:15 user nova-compute[72620]: WARNING nova.compute.manager [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received unexpected event network-vif-plugged-aea0a3e8-f7b9-46a0-8f96-798938408c91 for instance with vm_state deleted and task_state None.
Aug 09 20:44:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-6daf561b-b827-4ff0-ba65-56e25bfaaafa req-9a5f1729-9b66-489d-8258-11564f2bbf1c service nova] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Received event network-vif-deleted-0cda2006-85da-4432-ad9d-01e159808a82 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-abb3736d-c3ea-4ef4-8573-9b4143c41bfd tempest-VolumesActionsTest-1356058014 tempest-VolumesActionsTest-1356058014-project-member] Lock "c16dd2cb-02ea-4947-a9ef-98fc9833614a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLxZXihH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:16 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:16 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:16 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5a2fc-3087-4816-8faf-69c3dd879f0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:44:16 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d65844-1d8d-4062-b741-11f8b51ca8c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535] added
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45cd8a6-884a-4d81-9dea-c0cbebc6925e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.102s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce02170-2dfd-4aa9-9896-0f009e8fc2e1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLxZXihH {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tLxZXihH" returned: 0 in 0.135s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[754bb51d-7bfd-4f24-bb72-1e77c048f76e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tLxZXihH'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.124s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bf3281-645b-4fe9-b9f6-66929c805f03]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e73564-9c15-416c-b595-51fab17babc3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f095de-f9fc-45e9-aa97-72b64cdfa825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260]
Aug 09 20:44:16 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be7bc64-1a84-41e3-8bc0-7e535e8d6edc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15c5db-20e6-437f-8be7-cb7c61ed0580]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:16 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.650s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57cd9c2-ff7f-457f-a7b9-f6e09529e8f0]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-36b8a36f-223c-4680-8eca-b55e93bb98c9 req-d6af2ada-69ed-43c7-85e3-bd75365cf4f3 service nova] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Received event network-vif-deleted-aea0a3e8-f7b9-46a0-8f96-798938408c91 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLxZXihH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.683s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] <== connect_volume: return (1684ms) {'type': 'block', 'scsi_wwn': '23166633131613536', 'path': '/dev/sdh'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166633131613536', 'path': '/dev/sdh'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:44:17 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:17 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:17 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:17 user nova-compute[72620]:   <serial>8adda2b8-96fd-492b-a407-da38eb852535</serial>
Aug 09 20:44:17 user nova-compute[72620]: </disk>
Aug 09 20:44:17 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:44:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No BDM found with device name hda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] No VIF found with MAC fa:16:3e:c3:e5:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bffadbfe-efc8-4833-8ef3-6fe6ece27138 tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.530s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:19 user nova-compute[72620]: INFO nova.compute.manager [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Detaching volume 8adda2b8-96fd-492b-a407-da38eb852535
Aug 09 20:44:19 user nova-compute[72620]: INFO nova.virt.block_device [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Attempting to driver detach volume 8adda2b8-96fd-492b-a407-da38eb852535 from mountpoint /dev/vdb
Aug 09 20:44:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Attempting to detach device vdb from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:44:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:19 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:19 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:19 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:19 user nova-compute[72620]:   <serial>8adda2b8-96fd-492b-a407-da38eb852535</serial>
Aug 09 20:44:19 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 20:44:19 user nova-compute[72620]: </disk>
Aug 09 20:44:19 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully detached device vdb from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the persistent domain config.
Aug 09 20:44:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:44:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:44:19 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:44:19 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:44:19 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:44:19 user nova-compute[72620]:   <serial>8adda2b8-96fd-492b-a407-da38eb852535</serial>
Aug 09 20:44:19 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 20:44:19 user nova-compute[72620]: </disk>
Aug 09 20:44:19 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691613860.1168954, df2b7ed3-d447-46bc-9ef7-2edbe34d5883 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:44:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully detached device vdb from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the live domain config.
Aug 09 20:44:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tLxZXihH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[833dc626-a91d-42f6-9fca-6fef82b579dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[654a756b-69c9-42b9-b930-ccb3c01e4090]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:20 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30502200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535'): ({'sdh'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Removing single pathed devices sdh {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cdbac-9e22-4446-a982-f5bc28bc05e2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a72690-42b7-4a26-83ee-6b64299c697a]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Flushing IO for device /dev/sdh {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14fcdb-3323-4901-bda6-0d6da044d94b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb70f09-a223-490f-891a-dfce36b3dd1a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec15e324-5ee6-42f6-b20f-9edcbd7b7661]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d69df7-23cf-4d1f-975a-6b9ef4023fbe]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260]
Aug 09 20:44:20 user nova-compute[72620]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8adda2b8-96fd-492b-a407-da38eb852535 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc5c88-f62e-4de3-92fd-60cbe35b3a28]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] <== disconnect_volume: return (316ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:21 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9d4262c7-a1d1-4421-955a-185844199e1d tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.828s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-f1805ee7-2afc-4dde-8fb3-96a57c8b560c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-f1805ee7-2afc-4dde-8fb3-96a57c8b560c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Attempting to detach device tapf1805ee7-2a from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] detach device xml: <interface type="ethernet">
Aug 09 20:44:22 user nova-compute[72620]:   <mac address="fa:16:3e:b2:a3:4f"/>
Aug 09 20:44:22 user nova-compute[72620]:   <model type="virtio"/>
Aug 09 20:44:22 user nova-compute[72620]:   <mtu size="1442"/>
Aug 09 20:44:22 user nova-compute[72620]:   <target dev="tapf1805ee7-2a"/>
Aug 09 20:44:22 user nova-compute[72620]: </interface>
Aug 09 20:44:22 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 09 20:44:22 user nova-compute[72620]:   <name>instance-0000000a</name>
Aug 09 20:44:22 user nova-compute[72620]:   <uuid>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</uuid>
Aug 09 20:44:22 user nova-compute[72620]:   <metadata>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:22 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:00</nova:creationTime>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:22 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:22 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:22 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:port uuid="f1805ee7-2afc-4dde-8fb3-96a57c8b560c">
Aug 09 20:44:22 user nova-compute[72620]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 09 20:44:22 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:22 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:22 user nova-compute[72620]:   </metadata>
Aug 09 20:44:22 user nova-compute[72620]:   <memory unit='KiB'>524288</memory>
Aug 09 20:44:22 user nova-compute[72620]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 20:44:22 user nova-compute[72620]:   <vcpu placement='static'>1</vcpu>
Aug 09 20:44:22 user nova-compute[72620]:   <resource>
Aug 09 20:44:22 user nova-compute[72620]:     <partition>/machine</partition>
Aug 09 20:44:22 user nova-compute[72620]:   </resource>
Aug 09 20:44:22 user nova-compute[72620]:   <sysinfo type='smbios'>
Aug 09 20:44:22 user nova-compute[72620]:     <system>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='version'>0.0.0</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='serial'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='uuid'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='family'>Virtual Machine</entry>
Aug 09 20:44:22 user nova-compute[72620]:     </system>
Aug 09 20:44:22 user nova-compute[72620]:   </sysinfo>
Aug 09 20:44:22 user nova-compute[72620]:   <os>
Aug 09 20:44:22 user nova-compute[72620]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 20:44:22 user nova-compute[72620]:     <boot dev='hd'/>
Aug 09 20:44:22 user nova-compute[72620]:     <smbios mode='sysinfo'/>
Aug 09 20:44:22 user nova-compute[72620]:   </os>
Aug 09 20:44:22 user nova-compute[72620]:   <features>
Aug 09 20:44:22 user nova-compute[72620]:     <acpi/>
Aug 09 20:44:22 user nova-compute[72620]:     <apic/>
Aug 09 20:44:22 user nova-compute[72620]:     <vmcoreinfo state='on'/>
Aug 09 20:44:22 user nova-compute[72620]:   </features>
Aug 09 20:44:22 user nova-compute[72620]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 20:44:22 user nova-compute[72620]:     <model fallback='forbid'>Nehalem</model>
Aug 09 20:44:22 user nova-compute[72620]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='vme'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='x2apic'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='hypervisor'/>
Aug 09 20:44:22 user nova-compute[72620]:   </cpu>
Aug 09 20:44:22 user nova-compute[72620]:   <clock offset='utc'>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='hpet' present='no'/>
Aug 09 20:44:22 user nova-compute[72620]:   </clock>
Aug 09 20:44:22 user nova-compute[72620]:   <on_poweroff>destroy</on_poweroff>
Aug 09 20:44:22 user nova-compute[72620]:   <on_reboot>restart</on_reboot>
Aug 09 20:44:22 user nova-compute[72620]:   <on_crash>destroy</on_crash>
Aug 09 20:44:22 user nova-compute[72620]:   <devices>
Aug 09 20:44:22 user nova-compute[72620]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 20:44:22 user nova-compute[72620]:     <disk type='file' device='disk'>
Aug 09 20:44:22 user nova-compute[72620]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 20:44:22 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk' index='2'/>
Aug 09 20:44:22 user nova-compute[72620]:       <backingStore type='file' index='3'>
Aug 09 20:44:22 user nova-compute[72620]:         <format type='raw'/>
Aug 09 20:44:22 user nova-compute[72620]:         <source file='/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d'/>
Aug 09 20:44:22 user nova-compute[72620]:         <backingStore/>
Aug 09 20:44:22 user nova-compute[72620]:       </backingStore>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='vda' bus='virtio'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='virtio-disk0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </disk>
Aug 09 20:44:22 user nova-compute[72620]:     <disk type='file' device='cdrom'>
Aug 09 20:44:22 user nova-compute[72620]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 20:44:22 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config' index='1'/>
Aug 09 20:44:22 user nova-compute[72620]:       <backingStore/>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='hda' bus='ide'/>
Aug 09 20:44:22 user nova-compute[72620]:       <readonly/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='ide0-0-0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </disk>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='usb' index='0' model='none'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='usb'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='pci.0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='ide' index='0'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='ide'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <interface type='ethernet'>
Aug 09 20:44:22 user nova-compute[72620]:       <mac address='fa:16:3e:c3:e5:ba'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='tap74aae613-71'/>
Aug 09 20:44:22 user nova-compute[72620]:       <model type='virtio'/>
Aug 09 20:44:22 user nova-compute[72620]:       <mtu size='1442'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='net0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </interface>
Aug 09 20:44:22 user nova-compute[72620]:     <interface type='ethernet'>
Aug 09 20:44:22 user nova-compute[72620]:       <mac address='fa:16:3e:b2:a3:4f'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='tapf1805ee7-2a'/>
Aug 09 20:44:22 user nova-compute[72620]:       <model type='virtio'/>
Aug 09 20:44:22 user nova-compute[72620]:       <mtu size='1442'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='net1'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </interface>
Aug 09 20:44:22 user nova-compute[72620]:     <serial type='pty'>
Aug 09 20:44:22 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:22 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target type='isa-serial' port='0'>
Aug 09 20:44:22 user nova-compute[72620]:         <model name='isa-serial'/>
Aug 09 20:44:22 user nova-compute[72620]:       </target>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </serial>
Aug 09 20:44:22 user nova-compute[72620]:     <console type='pty' tty='/dev/pts/9'>
Aug 09 20:44:22 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:22 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target type='serial' port='0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </console>
Aug 09 20:44:22 user nova-compute[72620]:     <input type='mouse' bus='ps2'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='input0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </input>
Aug 09 20:44:22 user nova-compute[72620]:     <input type='keyboard' bus='ps2'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='input1'/>
Aug 09 20:44:22 user nova-compute[72620]:     </input>
Aug 09 20:44:22 user nova-compute[72620]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 20:44:22 user nova-compute[72620]:       <listen type='address' address='0.0.0.0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </graphics>
Aug 09 20:44:22 user nova-compute[72620]:     <audio id='1' type='none'/>
Aug 09 20:44:22 user nova-compute[72620]:     <video>
Aug 09 20:44:22 user nova-compute[72620]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='video0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </video>
Aug 09 20:44:22 user nova-compute[72620]:     <memballoon model='virtio'>
Aug 09 20:44:22 user nova-compute[72620]:       <stats period='10'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='balloon0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </memballoon>
Aug 09 20:44:22 user nova-compute[72620]:     <rng model='virtio'>
Aug 09 20:44:22 user nova-compute[72620]:       <backend model='random'>/dev/urandom</backend>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='rng0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </rng>
Aug 09 20:44:22 user nova-compute[72620]:   </devices>
Aug 09 20:44:22 user nova-compute[72620]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 20:44:22 user nova-compute[72620]:     <label>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</label>
Aug 09 20:44:22 user nova-compute[72620]:     <imagelabel>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</imagelabel>
Aug 09 20:44:22 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:22 user nova-compute[72620]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 20:44:22 user nova-compute[72620]:     <label>+64055:+108</label>
Aug 09 20:44:22 user nova-compute[72620]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 20:44:22 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:22 user nova-compute[72620]: </domain>
Aug 09 20:44:22 user nova-compute[72620]:  {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 20:44:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully detached device tapf1805ee7-2a from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the persistent domain config.
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] (1/8): Attempting to detach device tapf1805ee7-2a with device alias net1 from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] detach device xml: <interface type="ethernet">
Aug 09 20:44:22 user nova-compute[72620]:   <mac address="fa:16:3e:b2:a3:4f"/>
Aug 09 20:44:22 user nova-compute[72620]:   <model type="virtio"/>
Aug 09 20:44:22 user nova-compute[72620]:   <mtu size="1442"/>
Aug 09 20:44:22 user nova-compute[72620]:   <target dev="tapf1805ee7-2a"/>
Aug 09 20:44:22 user nova-compute[72620]: </interface>
Aug 09 20:44:22 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691613862.5704632, df2b7ed3-d447-46bc-9ef7-2edbe34d5883 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Start waiting for the detach event from libvirt for device tapf1805ee7-2a with device alias net1 for instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 09 20:44:22 user nova-compute[72620]:   <name>instance-0000000a</name>
Aug 09 20:44:22 user nova-compute[72620]:   <uuid>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</uuid>
Aug 09 20:44:22 user nova-compute[72620]:   <metadata>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:22 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:00</nova:creationTime>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:22 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:22 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:22 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:port uuid="f1805ee7-2afc-4dde-8fb3-96a57c8b560c">
Aug 09 20:44:22 user nova-compute[72620]:       <nova:ip type="fixed" address="10.10.10.148" ipVersion="4"/>
Aug 09 20:44:22 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:22 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:22 user nova-compute[72620]:   </metadata>
Aug 09 20:44:22 user nova-compute[72620]:   <memory unit='KiB'>524288</memory>
Aug 09 20:44:22 user nova-compute[72620]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 20:44:22 user nova-compute[72620]:   <vcpu placement='static'>1</vcpu>
Aug 09 20:44:22 user nova-compute[72620]:   <resource>
Aug 09 20:44:22 user nova-compute[72620]:     <partition>/machine</partition>
Aug 09 20:44:22 user nova-compute[72620]:   </resource>
Aug 09 20:44:22 user nova-compute[72620]:   <sysinfo type='smbios'>
Aug 09 20:44:22 user nova-compute[72620]:     <system>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='version'>0.0.0</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='serial'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='uuid'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:22 user nova-compute[72620]:       <entry name='family'>Virtual Machine</entry>
Aug 09 20:44:22 user nova-compute[72620]:     </system>
Aug 09 20:44:22 user nova-compute[72620]:   </sysinfo>
Aug 09 20:44:22 user nova-compute[72620]:   <os>
Aug 09 20:44:22 user nova-compute[72620]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 20:44:22 user nova-compute[72620]:     <boot dev='hd'/>
Aug 09 20:44:22 user nova-compute[72620]:     <smbios mode='sysinfo'/>
Aug 09 20:44:22 user nova-compute[72620]:   </os>
Aug 09 20:44:22 user nova-compute[72620]:   <features>
Aug 09 20:44:22 user nova-compute[72620]:     <acpi/>
Aug 09 20:44:22 user nova-compute[72620]:     <apic/>
Aug 09 20:44:22 user nova-compute[72620]:     <vmcoreinfo state='on'/>
Aug 09 20:44:22 user nova-compute[72620]:   </features>
Aug 09 20:44:22 user nova-compute[72620]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 20:44:22 user nova-compute[72620]:     <model fallback='forbid'>Nehalem</model>
Aug 09 20:44:22 user nova-compute[72620]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='vme'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='x2apic'/>
Aug 09 20:44:22 user nova-compute[72620]:     <feature policy='require' name='hypervisor'/>
Aug 09 20:44:22 user nova-compute[72620]:   </cpu>
Aug 09 20:44:22 user nova-compute[72620]:   <clock offset='utc'>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 20:44:22 user nova-compute[72620]:     <timer name='hpet' present='no'/>
Aug 09 20:44:22 user nova-compute[72620]:   </clock>
Aug 09 20:44:22 user nova-compute[72620]:   <on_poweroff>destroy</on_poweroff>
Aug 09 20:44:22 user nova-compute[72620]:   <on_reboot>restart</on_reboot>
Aug 09 20:44:22 user nova-compute[72620]:   <on_crash>destroy</on_crash>
Aug 09 20:44:22 user nova-compute[72620]:   <devices>
Aug 09 20:44:22 user nova-compute[72620]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 20:44:22 user nova-compute[72620]:     <disk type='file' device='disk'>
Aug 09 20:44:22 user nova-compute[72620]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 20:44:22 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk' index='2'/>
Aug 09 20:44:22 user nova-compute[72620]:       <backingStore type='file' index='3'>
Aug 09 20:44:22 user nova-compute[72620]:         <format type='raw'/>
Aug 09 20:44:22 user nova-compute[72620]:         <source file='/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d'/>
Aug 09 20:44:22 user nova-compute[72620]:         <backingStore/>
Aug 09 20:44:22 user nova-compute[72620]:       </backingStore>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='vda' bus='virtio'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='virtio-disk0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </disk>
Aug 09 20:44:22 user nova-compute[72620]:     <disk type='file' device='cdrom'>
Aug 09 20:44:22 user nova-compute[72620]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 20:44:22 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config' index='1'/>
Aug 09 20:44:22 user nova-compute[72620]:       <backingStore/>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='hda' bus='ide'/>
Aug 09 20:44:22 user nova-compute[72620]:       <readonly/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='ide0-0-0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </disk>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='usb' index='0' model='none'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='usb'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='pci.0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <controller type='ide' index='0'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='ide'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 20:44:22 user nova-compute[72620]:     </controller>
Aug 09 20:44:22 user nova-compute[72620]:     <interface type='ethernet'>
Aug 09 20:44:22 user nova-compute[72620]:       <mac address='fa:16:3e:c3:e5:ba'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target dev='tap74aae613-71'/>
Aug 09 20:44:22 user nova-compute[72620]:       <model type='virtio'/>
Aug 09 20:44:22 user nova-compute[72620]:       <mtu size='1442'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='net0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </interface>
Aug 09 20:44:22 user nova-compute[72620]:     <serial type='pty'>
Aug 09 20:44:22 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:22 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target type='isa-serial' port='0'>
Aug 09 20:44:22 user nova-compute[72620]:         <model name='isa-serial'/>
Aug 09 20:44:22 user nova-compute[72620]:       </target>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </serial>
Aug 09 20:44:22 user nova-compute[72620]:     <console type='pty' tty='/dev/pts/9'>
Aug 09 20:44:22 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:22 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:22 user nova-compute[72620]:       <target type='serial' port='0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </console>
Aug 09 20:44:22 user nova-compute[72620]:     <input type='mouse' bus='ps2'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='input0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </input>
Aug 09 20:44:22 user nova-compute[72620]:     <input type='keyboard' bus='ps2'>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='input1'/>
Aug 09 20:44:22 user nova-compute[72620]:     </input>
Aug 09 20:44:22 user nova-compute[72620]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 20:44:22 user nova-compute[72620]:       <listen type='address' address='0.0.0.0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </graphics>
Aug 09 20:44:22 user nova-compute[72620]:     <audio id='1' type='none'/>
Aug 09 20:44:22 user nova-compute[72620]:     <video>
Aug 09 20:44:22 user nova-compute[72620]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='video0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </video>
Aug 09 20:44:22 user nova-compute[72620]:     <memballoon model='virtio'>
Aug 09 20:44:22 user nova-compute[72620]:       <stats period='10'/>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='balloon0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </memballoon>
Aug 09 20:44:22 user nova-compute[72620]:     <rng model='virtio'>
Aug 09 20:44:22 user nova-compute[72620]:       <backend model='random'>/dev/urandom</backend>
Aug 09 20:44:22 user nova-compute[72620]:       <alias name='rng0'/>
Aug 09 20:44:22 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 20:44:22 user nova-compute[72620]:     </rng>
Aug 09 20:44:22 user nova-compute[72620]:   </devices>
Aug 09 20:44:22 user nova-compute[72620]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 20:44:22 user nova-compute[72620]:     <label>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</label>
Aug 09 20:44:22 user nova-compute[72620]:     <imagelabel>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</imagelabel>
Aug 09 20:44:22 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:22 user nova-compute[72620]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 20:44:22 user nova-compute[72620]:     <label>+64055:+108</label>
Aug 09 20:44:22 user nova-compute[72620]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 20:44:22 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:22 user nova-compute[72620]: </domain>
Aug 09 20:44:22 user nova-compute[72620]:  {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 20:44:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully detached device tapf1805ee7-2a from instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 from the live domain config.
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG os_vif [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1805ee7-2a, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:22 user nova-compute[72620]: INFO os_vif [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a')
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:22 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:22</nova:creationTime>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:22 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:22 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:22 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:22 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:22 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:22 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:22 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:22 user nova-compute[72620]:  {{(pid=72620) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-unplugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-unplugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:22 user nova-compute[72620]: WARNING nova.compute.manager [req-d5b1d797-f146-48ca-a2f7-24049f32d709 req-910828ca-b309-44ab-9d33-6747086c5c01 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-unplugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c for instance with vm_state active and task_state None.
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-deleted-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:23 user nova-compute[72620]: INFO nova.compute.manager [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Neutron deleted interface f1805ee7-2afc-4dde-8fb3-96a57c8b560c; detaching it from the instance and deleting it from the info cache
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquired lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.objects.instance [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Lazy-loading 'system_metadata' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.objects.instance [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Lazy-loading 'flavor' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 09 20:44:23 user nova-compute[72620]:   <name>instance-0000000a</name>
Aug 09 20:44:23 user nova-compute[72620]:   <uuid>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</uuid>
Aug 09 20:44:23 user nova-compute[72620]:   <metadata>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:23 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:22</nova:creationTime>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:23 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:23 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:23 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:23 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:23 user nova-compute[72620]:   </metadata>
Aug 09 20:44:23 user nova-compute[72620]:   <memory unit='KiB'>524288</memory>
Aug 09 20:44:23 user nova-compute[72620]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 20:44:23 user nova-compute[72620]:   <vcpu placement='static'>1</vcpu>
Aug 09 20:44:23 user nova-compute[72620]:   <resource>
Aug 09 20:44:23 user nova-compute[72620]:     <partition>/machine</partition>
Aug 09 20:44:23 user nova-compute[72620]:   </resource>
Aug 09 20:44:23 user nova-compute[72620]:   <sysinfo type='smbios'>
Aug 09 20:44:23 user nova-compute[72620]:     <system>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='version'>0.0.0</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='serial'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='uuid'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='family'>Virtual Machine</entry>
Aug 09 20:44:23 user nova-compute[72620]:     </system>
Aug 09 20:44:23 user nova-compute[72620]:   </sysinfo>
Aug 09 20:44:23 user nova-compute[72620]:   <os>
Aug 09 20:44:23 user nova-compute[72620]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 20:44:23 user nova-compute[72620]:     <boot dev='hd'/>
Aug 09 20:44:23 user nova-compute[72620]:     <smbios mode='sysinfo'/>
Aug 09 20:44:23 user nova-compute[72620]:   </os>
Aug 09 20:44:23 user nova-compute[72620]:   <features>
Aug 09 20:44:23 user nova-compute[72620]:     <acpi/>
Aug 09 20:44:23 user nova-compute[72620]:     <apic/>
Aug 09 20:44:23 user nova-compute[72620]:     <vmcoreinfo state='on'/>
Aug 09 20:44:23 user nova-compute[72620]:   </features>
Aug 09 20:44:23 user nova-compute[72620]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 20:44:23 user nova-compute[72620]:     <model fallback='forbid'>Nehalem</model>
Aug 09 20:44:23 user nova-compute[72620]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='vme'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='x2apic'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='hypervisor'/>
Aug 09 20:44:23 user nova-compute[72620]:   </cpu>
Aug 09 20:44:23 user nova-compute[72620]:   <clock offset='utc'>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='hpet' present='no'/>
Aug 09 20:44:23 user nova-compute[72620]:   </clock>
Aug 09 20:44:23 user nova-compute[72620]:   <on_poweroff>destroy</on_poweroff>
Aug 09 20:44:23 user nova-compute[72620]:   <on_reboot>restart</on_reboot>
Aug 09 20:44:23 user nova-compute[72620]:   <on_crash>destroy</on_crash>
Aug 09 20:44:23 user nova-compute[72620]:   <devices>
Aug 09 20:44:23 user nova-compute[72620]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 20:44:23 user nova-compute[72620]:     <disk type='file' device='disk'>
Aug 09 20:44:23 user nova-compute[72620]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 20:44:23 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk' index='2'/>
Aug 09 20:44:23 user nova-compute[72620]:       <backingStore type='file' index='3'>
Aug 09 20:44:23 user nova-compute[72620]:         <format type='raw'/>
Aug 09 20:44:23 user nova-compute[72620]:         <source file='/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d'/>
Aug 09 20:44:23 user nova-compute[72620]:         <backingStore/>
Aug 09 20:44:23 user nova-compute[72620]:       </backingStore>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='vda' bus='virtio'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='virtio-disk0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </disk>
Aug 09 20:44:23 user nova-compute[72620]:     <disk type='file' device='cdrom'>
Aug 09 20:44:23 user nova-compute[72620]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 20:44:23 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config' index='1'/>
Aug 09 20:44:23 user nova-compute[72620]:       <backingStore/>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='hda' bus='ide'/>
Aug 09 20:44:23 user nova-compute[72620]:       <readonly/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='ide0-0-0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </disk>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='usb' index='0' model='none'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='usb'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='pci.0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='ide' index='0'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='ide'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <interface type='ethernet'>
Aug 09 20:44:23 user nova-compute[72620]:       <mac address='fa:16:3e:c3:e5:ba'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='tap74aae613-71'/>
Aug 09 20:44:23 user nova-compute[72620]:       <model type='virtio'/>
Aug 09 20:44:23 user nova-compute[72620]:       <mtu size='1442'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='net0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </interface>
Aug 09 20:44:23 user nova-compute[72620]:     <serial type='pty'>
Aug 09 20:44:23 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:23 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target type='isa-serial' port='0'>
Aug 09 20:44:23 user nova-compute[72620]:         <model name='isa-serial'/>
Aug 09 20:44:23 user nova-compute[72620]:       </target>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </serial>
Aug 09 20:44:23 user nova-compute[72620]:     <console type='pty' tty='/dev/pts/9'>
Aug 09 20:44:23 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:23 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target type='serial' port='0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </console>
Aug 09 20:44:23 user nova-compute[72620]:     <input type='mouse' bus='ps2'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='input0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </input>
Aug 09 20:44:23 user nova-compute[72620]:     <input type='keyboard' bus='ps2'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='input1'/>
Aug 09 20:44:23 user nova-compute[72620]:     </input>
Aug 09 20:44:23 user nova-compute[72620]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 20:44:23 user nova-compute[72620]:       <listen type='address' address='0.0.0.0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </graphics>
Aug 09 20:44:23 user nova-compute[72620]:     <audio id='1' type='none'/>
Aug 09 20:44:23 user nova-compute[72620]:     <video>
Aug 09 20:44:23 user nova-compute[72620]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='video0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </video>
Aug 09 20:44:23 user nova-compute[72620]:     <memballoon model='virtio'>
Aug 09 20:44:23 user nova-compute[72620]:       <stats period='10'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='balloon0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </memballoon>
Aug 09 20:44:23 user nova-compute[72620]:     <rng model='virtio'>
Aug 09 20:44:23 user nova-compute[72620]:       <backend model='random'>/dev/urandom</backend>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='rng0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </rng>
Aug 09 20:44:23 user nova-compute[72620]:   </devices>
Aug 09 20:44:23 user nova-compute[72620]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 20:44:23 user nova-compute[72620]:     <label>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</label>
Aug 09 20:44:23 user nova-compute[72620]:     <imagelabel>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</imagelabel>
Aug 09 20:44:23 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:23 user nova-compute[72620]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 20:44:23 user nova-compute[72620]:     <label>+64055:+108</label>
Aug 09 20:44:23 user nova-compute[72620]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 20:44:23 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:23 user nova-compute[72620]: </domain>
Aug 09 20:44:23 user nova-compute[72620]:  {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface> {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:a3:4f"/><model type="virtio"/><mtu size="1442"/><target dev="tapf1805ee7-2a"/></interface>not found in domain: <domain type='kvm' id='10'>
Aug 09 20:44:23 user nova-compute[72620]:   <name>instance-0000000a</name>
Aug 09 20:44:23 user nova-compute[72620]:   <uuid>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</uuid>
Aug 09 20:44:23 user nova-compute[72620]:   <metadata>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:23 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:22</nova:creationTime>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:23 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:23 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:23 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:23 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:23 user nova-compute[72620]:   </metadata>
Aug 09 20:44:23 user nova-compute[72620]:   <memory unit='KiB'>524288</memory>
Aug 09 20:44:23 user nova-compute[72620]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 09 20:44:23 user nova-compute[72620]:   <vcpu placement='static'>1</vcpu>
Aug 09 20:44:23 user nova-compute[72620]:   <resource>
Aug 09 20:44:23 user nova-compute[72620]:     <partition>/machine</partition>
Aug 09 20:44:23 user nova-compute[72620]:   </resource>
Aug 09 20:44:23 user nova-compute[72620]:   <sysinfo type='smbios'>
Aug 09 20:44:23 user nova-compute[72620]:     <system>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='product'>OpenStack Nova</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='version'>0.0.0</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='serial'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='uuid'>df2b7ed3-d447-46bc-9ef7-2edbe34d5883</entry>
Aug 09 20:44:23 user nova-compute[72620]:       <entry name='family'>Virtual Machine</entry>
Aug 09 20:44:23 user nova-compute[72620]:     </system>
Aug 09 20:44:23 user nova-compute[72620]:   </sysinfo>
Aug 09 20:44:23 user nova-compute[72620]:   <os>
Aug 09 20:44:23 user nova-compute[72620]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 09 20:44:23 user nova-compute[72620]:     <boot dev='hd'/>
Aug 09 20:44:23 user nova-compute[72620]:     <smbios mode='sysinfo'/>
Aug 09 20:44:23 user nova-compute[72620]:   </os>
Aug 09 20:44:23 user nova-compute[72620]:   <features>
Aug 09 20:44:23 user nova-compute[72620]:     <acpi/>
Aug 09 20:44:23 user nova-compute[72620]:     <apic/>
Aug 09 20:44:23 user nova-compute[72620]:     <vmcoreinfo state='on'/>
Aug 09 20:44:23 user nova-compute[72620]:   </features>
Aug 09 20:44:23 user nova-compute[72620]:   <cpu mode='custom' match='exact' check='full'>
Aug 09 20:44:23 user nova-compute[72620]:     <model fallback='forbid'>Nehalem</model>
Aug 09 20:44:23 user nova-compute[72620]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='vme'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='x2apic'/>
Aug 09 20:44:23 user nova-compute[72620]:     <feature policy='require' name='hypervisor'/>
Aug 09 20:44:23 user nova-compute[72620]:   </cpu>
Aug 09 20:44:23 user nova-compute[72620]:   <clock offset='utc'>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='pit' tickpolicy='delay'/>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 09 20:44:23 user nova-compute[72620]:     <timer name='hpet' present='no'/>
Aug 09 20:44:23 user nova-compute[72620]:   </clock>
Aug 09 20:44:23 user nova-compute[72620]:   <on_poweroff>destroy</on_poweroff>
Aug 09 20:44:23 user nova-compute[72620]:   <on_reboot>restart</on_reboot>
Aug 09 20:44:23 user nova-compute[72620]:   <on_crash>destroy</on_crash>
Aug 09 20:44:23 user nova-compute[72620]:   <devices>
Aug 09 20:44:23 user nova-compute[72620]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 09 20:44:23 user nova-compute[72620]:     <disk type='file' device='disk'>
Aug 09 20:44:23 user nova-compute[72620]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 09 20:44:23 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk' index='2'/>
Aug 09 20:44:23 user nova-compute[72620]:       <backingStore type='file' index='3'>
Aug 09 20:44:23 user nova-compute[72620]:         <format type='raw'/>
Aug 09 20:44:23 user nova-compute[72620]:         <source file='/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d'/>
Aug 09 20:44:23 user nova-compute[72620]:         <backingStore/>
Aug 09 20:44:23 user nova-compute[72620]:       </backingStore>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='vda' bus='virtio'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='virtio-disk0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </disk>
Aug 09 20:44:23 user nova-compute[72620]:     <disk type='file' device='cdrom'>
Aug 09 20:44:23 user nova-compute[72620]:       <driver name='qemu' type='raw' cache='none'/>
Aug 09 20:44:23 user nova-compute[72620]:       <source file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk.config' index='1'/>
Aug 09 20:44:23 user nova-compute[72620]:       <backingStore/>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='hda' bus='ide'/>
Aug 09 20:44:23 user nova-compute[72620]:       <readonly/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='ide0-0-0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </disk>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='usb' index='0' model='none'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='usb'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='pci' index='0' model='pci-root'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='pci.0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <controller type='ide' index='0'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='ide'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 09 20:44:23 user nova-compute[72620]:     </controller>
Aug 09 20:44:23 user nova-compute[72620]:     <interface type='ethernet'>
Aug 09 20:44:23 user nova-compute[72620]:       <mac address='fa:16:3e:c3:e5:ba'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target dev='tap74aae613-71'/>
Aug 09 20:44:23 user nova-compute[72620]:       <model type='virtio'/>
Aug 09 20:44:23 user nova-compute[72620]:       <mtu size='1442'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='net0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </interface>
Aug 09 20:44:23 user nova-compute[72620]:     <serial type='pty'>
Aug 09 20:44:23 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:23 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target type='isa-serial' port='0'>
Aug 09 20:44:23 user nova-compute[72620]:         <model name='isa-serial'/>
Aug 09 20:44:23 user nova-compute[72620]:       </target>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </serial>
Aug 09 20:44:23 user nova-compute[72620]:     <console type='pty' tty='/dev/pts/9'>
Aug 09 20:44:23 user nova-compute[72620]:       <source path='/dev/pts/9'/>
Aug 09 20:44:23 user nova-compute[72620]:       <log file='/opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/console.log' append='off'/>
Aug 09 20:44:23 user nova-compute[72620]:       <target type='serial' port='0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='serial0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </console>
Aug 09 20:44:23 user nova-compute[72620]:     <input type='mouse' bus='ps2'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='input0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </input>
Aug 09 20:44:23 user nova-compute[72620]:     <input type='keyboard' bus='ps2'>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='input1'/>
Aug 09 20:44:23 user nova-compute[72620]:     </input>
Aug 09 20:44:23 user nova-compute[72620]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Aug 09 20:44:23 user nova-compute[72620]:       <listen type='address' address='0.0.0.0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </graphics>
Aug 09 20:44:23 user nova-compute[72620]:     <audio id='1' type='none'/>
Aug 09 20:44:23 user nova-compute[72620]:     <video>
Aug 09 20:44:23 user nova-compute[72620]:       <model type='virtio' heads='1' primary='yes'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='video0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </video>
Aug 09 20:44:23 user nova-compute[72620]:     <memballoon model='virtio'>
Aug 09 20:44:23 user nova-compute[72620]:       <stats period='10'/>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='balloon0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </memballoon>
Aug 09 20:44:23 user nova-compute[72620]:     <rng model='virtio'>
Aug 09 20:44:23 user nova-compute[72620]:       <backend model='random'>/dev/urandom</backend>
Aug 09 20:44:23 user nova-compute[72620]:       <alias name='rng0'/>
Aug 09 20:44:23 user nova-compute[72620]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 09 20:44:23 user nova-compute[72620]:     </rng>
Aug 09 20:44:23 user nova-compute[72620]:   </devices>
Aug 09 20:44:23 user nova-compute[72620]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 09 20:44:23 user nova-compute[72620]:     <label>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</label>
Aug 09 20:44:23 user nova-compute[72620]:     <imagelabel>libvirt-df2b7ed3-d447-46bc-9ef7-2edbe34d5883</imagelabel>
Aug 09 20:44:23 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:23 user nova-compute[72620]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 09 20:44:23 user nova-compute[72620]:     <label>+64055:+108</label>
Aug 09 20:44:23 user nova-compute[72620]:     <imagelabel>+64055:+108</imagelabel>
Aug 09 20:44:23 user nova-compute[72620]:   </seclabel>
Aug 09 20:44:23 user nova-compute[72620]: </domain>
Aug 09 20:44:23 user nova-compute[72620]:  {{(pid=72620) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 09 20:44:23 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Detaching interface fa:16:3e:b2:a3:4f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf1805ee7-2a' not found.
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Converting VIF {"id": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "address": "fa:16:3e:b2:a3:4f", "network": {"id": "7997092f-0724-4f4e-a505-1c17d599ae84", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1236168113", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1805ee7-2a", "ovs_interfaceid": "f1805ee7-2afc-4dde-8fb3-96a57c8b560c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG os_vif [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1805ee7-2a, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:44:23 user nova-compute[72620]: INFO os_vif [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:a3:4f,bridge_name='br-int',has_traffic_filtering=True,id=f1805ee7-2afc-4dde-8fb3-96a57c8b560c,network=Network(7997092f-0724-4f4e-a505-1c17d599ae84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1805ee7-2a')
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [req-9fd81e62-3dce-4f1c-aeb8-7dee42fd7bbc req-07237565-4c38-45e7-9f02-1698f72cafe6 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:23 user nova-compute[72620]:   <nova:package version="0.0.0"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:name>tempest-device-tagging-server-1620747692</nova:name>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:creationTime>2023-08-09 20:44:23</nova:creationTime>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:flavor name="m1.tiny">
Aug 09 20:44:23 user nova-compute[72620]:     <nova:memory>512</nova:memory>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:disk>1</nova:disk>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:swap>0</nova:swap>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:flavor>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:user uuid="88004f63268d4b889d25b8f51c825557">tempest-TaggedAttachmentsTest-1023541733-project-member</nova:user>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:project uuid="3baafdb5a61a44878847326c13daa6c9">tempest-TaggedAttachmentsTest-1023541733</nova:project>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:owner>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:23 user nova-compute[72620]:   <nova:ports>
Aug 09 20:44:23 user nova-compute[72620]:     <nova:port uuid="74aae613-71c2-43a4-8774-a3cc27def6e5">
Aug 09 20:44:23 user nova-compute[72620]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:44:23 user nova-compute[72620]:     </nova:port>
Aug 09 20:44:23 user nova-compute[72620]:   </nova:ports>
Aug 09 20:44:23 user nova-compute[72620]: </nova:instance>
Aug 09 20:44:23 user nova-compute[72620]:  {{(pid=72620) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 09 20:44:23 user nova-compute[72620]: INFO nova.network.neutron [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Port f1805ee7-2afc-4dde-8fb3-96a57c8b560c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 09 20:44:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [{"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Releasing lock "refresh_cache-df2b7ed3-d447-46bc-9ef7-2edbe34d5883" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1782b7fb-78c6-4d87-b055-1b4d82e8b9ad tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "interface-df2b7ed3-d447-46bc-9ef7-2edbe34d5883-f1805ee7-2afc-4dde-8fb3-96a57c8b560c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.775s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:24 user nova-compute[72620]: WARNING nova.compute.manager [req-151a2e1f-f84b-4add-b264-e749152c21f1 req-909de405-861f-4ac6-aab7-249bf4a6a9be service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-f1805ee7-2afc-4dde-8fb3-96a57c8b560c for instance with vm_state active and task_state None.
Aug 09 20:44:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:27 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613852.722881, fc732850-9f28-4686-9c6a-763fc475be82 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:44:27 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fc732850-9f28-4686-9c6a-763fc475be82] VM Stopped (Lifecycle Event)
Aug 09 20:44:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-789a824c-118e-4a30-b09b-002bc816d02f None None] [instance: fc732850-9f28-4686-9c6a-763fc475be82] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:44:28 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613853.4072258, c16dd2cb-02ea-4947-a9ef-98fc9833614a => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:44:28 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] VM Stopped (Lifecycle Event)
Aug 09 20:44:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d293542-db02-4922-a982-e8694092740e None None] [instance: c16dd2cb-02ea-4947-a9ef-98fc9833614a] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:44:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-changed-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing instance network info cache due to event network-changed-00ba02c5-bb08-41bc-b900-860bc7f7596e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:44:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] Acquiring lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:44:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] Acquired lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:44:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Refreshing network info cache for port 00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:44:41 user nova-compute[72620]: DEBUG nova.network.neutron [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updated VIF entry in instance network info cache for port 00ba02c5-bb08-41bc-b900-860bc7f7596e. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:44:41 user nova-compute[72620]: DEBUG nova.network.neutron [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-311ac769-171c-452f-b8c5-57f22a520fec req-649ecee6-0880-40b1-a947-0a8f0342c590 service nova] Releasing lock "refresh_cache-4ae767ef-9a76-40a8-8f7c-6f126c99af14" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:44:43 user nova-compute[72620]: INFO nova.compute.claims [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Claim successful on node user
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:43 user nova-compute[72620]: INFO nova.compute.manager [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Terminating instance
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-956bd3c6-e784-450c-98c6-542a68149bae req-c1f63f63-bff9-42e8-bca8-b22e5111a52f service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-00ba02c5-bb08-41bc-b900-860bc7f7596e for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.policy [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f794b9e72d4443e86ada7b257af84a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f5de1122514369a2b3f71ae1146194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:44:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Creating image(s)
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-711dc7d6-799a-4266-95ee-2264dbf236b5 req-ea0a5b32-45e7-4a81-a64e-b711b1a6a1fe service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk 1073741824" returned: 0 in 0.122s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.184s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Successfully created port: 5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Cannot resize image /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'migration_context' on Instance uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Ensure instance console log exists: /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Instance destroyed successfully.
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lazy-loading 'resources' on Instance uuid 4ae767ef-9a76-40a8-8f7c-6f126c99af14 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00ba02c5-bb, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:57:4d,bridge_name='br-int',has_traffic_filtering=True,id=00ba02c5-bb08-41bc-b900-860bc7f7596e,network=Network(b60a8ee5-9380-4387-9155-87e8489e2003),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00ba02c5-bb')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3420c779-30, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:14:c8,bridge_name='br-int',has_traffic_filtering=True,id=3420c779-3075-4496-908d-84098c616a5c,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3420c779-30')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b304fe8-21, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:6b:fe,bridge_name='br-int',has_traffic_filtering=True,id=4b304fe8-21fc-4fab-bd5b-856340dc5a2b,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4b304fe8-21')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap371c1b3a-f7, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:ca:6d,bridge_name='br-int',has_traffic_filtering=True,id=371c1b3a-f7b3-4d8c-aa5e-60d060350300,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371c1b3a-f7')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e5da83-30, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:67:ff,bridge_name='br-int',has_traffic_filtering=True,id=10e5da83-3056-4a14-8ef9-97c9448e3756,network=Network(55aa015c-0b0d-4e5f-9112-5d2ba4d1b445),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e5da83-30')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaacf977c-c6, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:2b:cd,bridge_name='br-int',has_traffic_filtering=True,id=aacf977c-c650-4b08-b762-b4e3f02eb229,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaacf977c-c6')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-158600537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-158600537',id=12,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4RI4NKMwNv4K5dBg6NP1Pz1iOfQ5R+HuAfliXF0XdLIaZDs+QrOr569CnDCBR++llUw/90SPm7C4lsEVPaOHoTZKEKEeurRJwn0VOT8mkOtWZTIHALdZn/mNI8j6cF+g==',key_name='tempest-keypair-1891536472',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca46c4036f6a4fdd9a2eff188aad66b3',ramdisk_id='',reservation_id='r-b1mo440v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-367732195',owner_user_name='tempest-TaggedBootDevicesTest-367732195-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6eddd469e10944008e6ffdd6b42d9595',uuid=4ae767ef-9a76-40a8-8f7c-6f126c99af14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converting VIF {"id": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "address": "fa:16:3e:f2:11:eb", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaad44491-e3", "ovs_interfaceid": "aad44491-e3fa-4946-961c-0ab05aebf9e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaad44491-e3, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:45 user nova-compute[72620]: INFO os_vif [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:11:eb,bridge_name='br-int',has_traffic_filtering=True,id=aad44491-e3fa-4946-961c-0ab05aebf9e1,network=Network(6ebeffc7-17af-4525-946e-165eb14fc140),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaad44491-e3')
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VAyPFfkJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b493f4d9-9506-4616-8726-e6f9e8960a8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9526b7dc-cc7e-4ddf-a01b-7fe029851010]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:45 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30561e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf55c76-a2eb-4f39-9202-700b330e119f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a6006-a1e1-43f4-9615-bf9a2039a0f4]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfcff0e-5a26-49ff-bd24-a0bccab75d68]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd569a1-0c02-4acf-bf1b-aecbd9c5112a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf454d-2275-431b-b40e-1cef868d445c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Successfully updated port: 5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-changed-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Refreshing instance network info cache due to event network-changed-5b43775c-c150-4ddd-9154-821de5d93d7f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:44:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a0e3c-0945-4872-b3a0-6d7fed03a26a]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260]
Aug 09 20:44:46 user nova-compute[72620]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3b7e56f-5a59-44d9-acfa-f14550e614c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1abcfa-2aad-46b4-a802-7bff31629f67]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== disconnect_volume: return (337ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bMwRaIlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae1cee-cf3b-4807-bb24-3995b8fe31ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d8df16-2da3-4bd4-8231-6b48835ff6e1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30573a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9862296c-1742-444a-af35-a2313eb31d01]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-00ba02c5-bb08-41bc-b900-860bc7f7596e for instance with vm_state active and task_state deleting.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-3420c779-3075-4496-908d-84098c616a5c for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-3420c779-3075-4496-908d-84098c616a5c for instance with vm_state active and task_state deleting.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-4b304fe8-21fc-4fab-bd5b-856340dc5a2b for instance with vm_state active and task_state deleting.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-158926ad-b58e-4cbd-b336-02d3a0385e00 req-24198fa6-f9ff-4e5c-a7c3-860582f46335 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae61335e-ea4a-46fe-b2f2-f3ef257a6bc7]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c61ba0-7bdd-4be9-b504-725cab16c962]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bff49d6-3aac-4990-994e-fcf6052449d1]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Instance network_info: |[{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Refreshing network info cache for port 5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Start _get_guest_xml network_info=[{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91385f7-6d33-4342-b122-90ae8f60e19f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524310984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524310984',id=13,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-ia0z2dlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:44:44Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=9cf87b7e-fd60-47df-b8ea-071fed88ca72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:44:46 user nova-compute[72620]:   <uuid>9cf87b7e-fd60-47df-b8ea-071fed88ca72</uuid>
Aug 09 20:44:46 user nova-compute[72620]:   <name>instance-0000000d</name>
Aug 09 20:44:46 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:44:46 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:44:46 user nova-compute[72620]:   <metadata>
Aug 09 20:44:46 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:44:46 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-524310984</nova:name>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:44:46</nova:creationTime>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:44:46 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:44:46 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:owner>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:44:46 user nova-compute[72620]:       </nova:owner>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:44:46 user nova-compute[72620]:       <nova:ports>
Aug 09 20:44:46 user nova-compute[72620]:         <nova:port uuid="5b43775c-c150-4ddd-9154-821de5d93d7f">
Aug 09 20:44:46 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 20:44:46 user nova-compute[72620]:         </nova:port>
Aug 09 20:44:46 user nova-compute[72620]:       </nova:ports>
Aug 09 20:44:46 user nova-compute[72620]:     </nova:instance>
Aug 09 20:44:46 user nova-compute[72620]:   </metadata>
Aug 09 20:44:46 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:44:46 user nova-compute[72620]:     <system>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="serial">9cf87b7e-fd60-47df-b8ea-071fed88ca72</entry>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="uuid">9cf87b7e-fd60-47df-b8ea-071fed88ca72</entry>
Aug 09 20:44:46 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:44:46 user nova-compute[72620]:     </system>
Aug 09 20:44:46 user nova-compute[72620]:   </sysinfo>
Aug 09 20:44:46 user nova-compute[72620]:   <os>
Aug 09 20:44:46 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:44:46 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:44:46 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:44:46 user nova-compute[72620]:   </os>
Aug 09 20:44:46 user nova-compute[72620]:   <features>
Aug 09 20:44:46 user nova-compute[72620]:     <acpi/>
Aug 09 20:44:46 user nova-compute[72620]:     <apic/>
Aug 09 20:44:46 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:44:46 user nova-compute[72620]:   </features>
Aug 09 20:44:46 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:44:46 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:44:46 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:44:46 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:44:46 user nova-compute[72620]:   </clock>
Aug 09 20:44:46 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:44:46 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:44:46 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:44:46 user nova-compute[72620]:   </cpu>
Aug 09 20:44:46 user nova-compute[72620]:   <devices>
Aug 09 20:44:46 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:44:46 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:44:46 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk"/>
Aug 09 20:44:46 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:44:46 user nova-compute[72620]:     </disk>
Aug 09 20:44:46 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:44:46 user nova-compute[72620]:       <mac address="fa:16:3e:ad:0c:04"/>
Aug 09 20:44:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:44:46 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:44:46 user nova-compute[72620]:       <target dev="tap5b43775c-c1"/>
Aug 09 20:44:46 user nova-compute[72620]:     </interface>
Aug 09 20:44:46 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:44:46 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/console.log" append="off"/>
Aug 09 20:44:46 user nova-compute[72620]:     </serial>
Aug 09 20:44:46 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:44:46 user nova-compute[72620]:     <video>
Aug 09 20:44:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:44:46 user nova-compute[72620]:     </video>
Aug 09 20:44:46 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:44:46 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:44:46 user nova-compute[72620]:     </rng>
Aug 09 20:44:46 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:44:46 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:44:46 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:44:46 user nova-compute[72620]:     </memballoon>
Aug 09 20:44:46 user nova-compute[72620]:   </devices>
Aug 09 20:44:46 user nova-compute[72620]: </domain>
Aug 09 20:44:46 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524310984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524310984',id=13,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-ia0z2dlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:44:44Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=9cf87b7e-fd60-47df-b8ea-071fed88ca72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_vif [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fce7cb-64a4-4502-966f-6e8ba63c03a8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260]
Aug 09 20:44:46 user nova-compute[72620]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b43775c-c1, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b43775c-c1, col_values=(('external_ids', {'iface-id': '5b43775c-c150-4ddd-9154-821de5d93d7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:0c:04', 'vm-uuid': '9cf87b7e-fd60-47df-b8ea-071fed88ca72'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:46 user nova-compute[72620]: INFO os_vif [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1')
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:310e519b-cbf2-4955-b1af-3af2f6e973d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e651d6-f831-4390-89b8-16550cbdc7b8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== disconnect_volume: return (372ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcTinSVU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5fcabb-1aef-450f-8c8e-2e16442b4f6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad80a4-1e1c-4b17-b1ff-a95fc77ed6d2]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:44:46 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d283ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:ad:0c:04, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c445b9-22e0-40d5-9118-6ed61231a59c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4eaacb-b6c6-4db1-8aa7-a741c27d2fb5]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb37b5-da3d-49a6-90f0-4e08b51c0b4f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[527108a0-635b-4720-9027-0ce6ea2babe0]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aabced-71fb-47b6-9557-84727705f8c9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:46 user nova-compute[72620]: WARNING nova.compute.manager [req-01076f94-d341-4a5c-a093-32ecd9bd4c98 req-e355fd7c-8ce1-4544-a945-9f8337cd9189 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aad44491-e3fa-4946-961c-0ab05aebf9e1 for instance with vm_state active and task_state deleting.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a3b4b4-fe3f-43c1-99f0-095ba42162b3]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260]
Aug 09 20:44:46 user nova-compute[72620]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9, portal: 172.16.0.220,3260] successful.
Aug 09 20:44:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41eb5d76-b945-4650-86cd-b0ebdb463dc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c5c2f-6d50-46b0-be2e-3cc7befcb920]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] <== disconnect_volume: return (305ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:44:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Deleting instance files /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14_del
Aug 09 20:44:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Deletion of /opt/stack/data/nova/instances/4ae767ef-9a76-40a8-8f7c-6f126c99af14_del complete
Aug 09 20:44:46 user nova-compute[72620]: INFO nova.compute.manager [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Took 3.34 seconds to destroy the instance on the hypervisor.
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updated VIF entry in instance network info cache for port 5b43775c-c150-4ddd-9154-821de5d93d7f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1653af61-c2af-4787-b744-70230c7cf7aa req-04aa5b82-e11d-4990-9d8e-aa37c10872dd service nova] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: WARNING nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-371c1b3a-f7b3-4d8c-aa5e-60d060350300 for instance with vm_state active and task_state deleting.
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-10e5da83-3056-4a14-8ef9-97c9448e3756 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: WARNING nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-10e5da83-3056-4a14-8ef9-97c9448e3756 for instance with vm_state active and task_state deleting.
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-unplugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-unplugged-aacf977c-c650-4b08-b762-b4e3f02eb229 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] No waiting events found dispatching network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: WARNING nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received unexpected event network-vif-plugged-aacf977c-c650-4b08-b762-b4e3f02eb229 for instance with vm_state active and task_state deleting.
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:48 user nova-compute[72620]: WARNING nova.compute.manager [req-2134aa1b-3698-4acd-96fe-48e67406bfaa req-a6b895e6-8990-4c2f-8176-1466b3715d68 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state building and task_state spawning.
Aug 09 20:44:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-80fe4cac-a534-4178-85ca-3de74e387490 req-3190c1e6-c06b-49ed-94b3-bbcdeb21ea5d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-deleted-aad44491-e3fa-4946-961c-0ab05aebf9e1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:48 user nova-compute[72620]: INFO nova.compute.manager [req-80fe4cac-a534-4178-85ca-3de74e387490 req-3190c1e6-c06b-49ed-94b3-bbcdeb21ea5d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Neutron deleted interface aad44491-e3fa-4946-961c-0ab05aebf9e1; detaching it from the instance and deleting it from the info cache
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-80fe4cac-a534-4178-85ca-3de74e387490 req-3190c1e6-c06b-49ed-94b3-bbcdeb21ea5d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [{"id": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "address": "fa:16:3e:07:57:4d", "network": {"id": "b60a8ee5-9380-4387-9155-87e8489e2003", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1556638330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00ba02c5-bb", "ovs_interfaceid": "00ba02c5-bb08-41bc-b900-860bc7f7596e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3420c779-3075-4496-908d-84098c616a5c", "address": "fa:16:3e:86:14:c8", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3420c779-30", "ovs_interfaceid": "3420c779-3075-4496-908d-84098c616a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "address": "fa:16:3e:6b:6b:fe", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b304fe8-21", "ovs_interfaceid": "4b304fe8-21fc-4fab-bd5b-856340dc5a2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "address": "fa:16:3e:5b:ca:6d", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap371c1b3a-f7", "ovs_interfaceid": "371c1b3a-f7b3-4d8c-aa5e-60d060350300", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10e5da83-3056-4a14-8ef9-97c9448e3756", "address": "fa:16:3e:ea:67:ff", "network": {"id": "55aa015c-0b0d-4e5f-9112-5d2ba4d1b445", "bridge": "br-int", "label": "tempest-device-tagging-net1-1440528648", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.86", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e5da83-30", "ovs_interfaceid": "10e5da83-3056-4a14-8ef9-97c9448e3756", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "aacf977c-c650-4b08-b762-b4e3f02eb229", "address": "fa:16:3e:da:2b:cd", "network": {"id": "6ebeffc7-17af-4525-946e-165eb14fc140", "bridge": "br-int", "label": "tempest-device-tagging-net2-1782744880", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ca46c4036f6a4fdd9a2eff188aad66b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaacf977c-c6", "ovs_interfaceid": "aacf977c-c650-4b08-b762-b4e3f02eb229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-80fe4cac-a534-4178-85ca-3de74e387490 req-3190c1e6-c06b-49ed-94b3-bbcdeb21ea5d service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Detach interface failed, port_id=aad44491-e3fa-4946-961c-0ab05aebf9e1, reason: Instance 4ae767ef-9a76-40a8-8f7c-6f126c99af14 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613890.0292213, 9cf87b7e-fd60-47df-b8ea-071fed88ca72 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] VM Resumed (Lifecycle Event)
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Instance spawned successfully.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613890.0340116, 9cf87b7e-fd60-47df-b8ea-071fed88ca72 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] VM Started (Lifecycle Event)
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Took 6.85 seconds to build instance.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bcef7595-a487-48d6-a58d-69e3238b7aab tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:44:50 user nova-compute[72620]: WARNING nova.compute.manager [req-643b7126-317a-4e5b-b2ac-e672e608c423 req-f5a9b54c-a956-4207-a094-1aed3a565267 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state active and task_state None.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:50 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Took 4.02 seconds to deallocate network for instance.
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-7448339d-336c-46be-ad8f-d303c11be6d2 req-9b1ce991-9c03-49de-a454-74dbdfd0a0d2 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-deleted-00ba02c5-bb08-41bc-b900-860bc7f7596e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-7448339d-336c-46be-ad8f-d303c11be6d2 req-9b1ce991-9c03-49de-a454-74dbdfd0a0d2 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-deleted-aacf977c-c650-4b08-b762-b4e3f02eb229 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-7448339d-336c-46be-ad8f-d303c11be6d2 req-9b1ce991-9c03-49de-a454-74dbdfd0a0d2 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-deleted-10e5da83-3056-4a14-8ef9-97c9448e3756 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-7448339d-336c-46be-ad8f-d303c11be6d2 req-9b1ce991-9c03-49de-a454-74dbdfd0a0d2 service nova] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Received event network-vif-deleted-371c1b3a-f7b3-4d8c-aa5e-60d060350300 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:44:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Skipping network cache update for instance because it is being deleted. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:44:55 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:44:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:44:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.621681213378906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:44:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 4ae767ef-9a76-40a8-8f7c-6f126c99af14 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613885.2361434, 4ae767ef-9a76-40a8-8f7c-6f126c99af14 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:00 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] VM Stopped (Lifecycle Event)
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-8811cfca-996b-4877-aec8-01fdc996e4e7 None None] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:45:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:45:02 user nova-compute[72620]: INFO nova.compute.claims [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Claim successful on node user
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:45:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.policy [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97d6d0ff7eee41559a923dfafce80855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8904bc2939444f9a9270c2b48043bc6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:45:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Creating image(s)
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "/opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "/opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "/opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:03 user nova-compute[72620]: INFO nova.compute.manager [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Terminating instance
Aug 09 20:45:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.175s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk 1073741824" returned: 0 in 0.057s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-unplugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] No waiting events found dispatching network-vif-unplugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-137d2872-4f1f-4728-b1cc-552b592a8b0c req-a676ab8e-f3f4-4035-9fbd-45f291288ce5 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-unplugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.162s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Cannot resize image /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'migration_context' on Instance uuid efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Ensure instance console log exists: /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Successfully created port: e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:45:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Instance destroyed successfully.
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lazy-loading 'resources' on Instance uuid 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375255164',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375255164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375255164',id=7,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGr8foXHXJLlTQaKikQDgxW00Wp4h9W/VkVWml5QvpaLivYZpYYjEEfYWfoayvMl/g7zTXMN5PWcexbyiUeH8W7LbBaWbxfS5ac52NK/H4Rya/i5hK4JochVKQRe66byg==',key_name='tempest-keypair-889436008',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eae1f11b67f948dbb2c78d07b28971c5',ramdisk_id='',reservation_id='r-sfjzz0gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-326438208',owner_user_name='tempest-VolumesAssistedSnapshotsTest-326438208-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d35d2156d9ed4cbbbaa8ae6bac1aecd1',uuid=1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converting VIF {"id": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "address": "fa:16:3e:9e:0a:a7", "network": {"id": "af241926-1395-4c86-a71e-565e0973654e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1735503732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eae1f11b67f948dbb2c78d07b28971c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6db33a86-8c", "ovs_interfaceid": "6db33a86-8c64-4493-8db3-bf494a12dbf4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG os_vif [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6db33a86-8c, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:04 user nova-compute[72620]: INFO os_vif [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:0a:a7,bridge_name='br-int',has_traffic_filtering=True,id=6db33a86-8c64-4493-8db3-bf494a12dbf4,network=Network(af241926-1395-4c86-a71e-565e0973654e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6db33a86-8c')
Aug 09 20:45:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Deleting instance files /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c_del
Aug 09 20:45:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Deletion of /opt/stack/data/nova/instances/1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c_del complete
Aug 09 20:45:04 user nova-compute[72620]: INFO nova.compute.manager [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 20:45:04 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:45:04 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Successfully updated port: e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquired lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-changed-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Refreshing instance network info cache due to event network-changed-e4e3a9d6-32af-45ee-b55f-b97c2070c456. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] Acquiring lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:45:05 user nova-compute[72620]: INFO nova.compute.manager [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] [instance: 4ae767ef-9a76-40a8-8f7c-6f126c99af14] Took 14.95 seconds to detach 3 volumes for instance.
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:05 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Took 1.05 seconds to deallocate network for instance.
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-ed46b639-b1a8-427d-9162-05385018762a req-eaecc92e-271d-4d0d-b7b5-e84217c39d1a service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-deleted-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Updating instance_info_cache with network_info: [{"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Releasing lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Instance network_info: |[{"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] Acquired lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.network.neutron [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Refreshing network info cache for port e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Start _get_guest_xml network_info=[{"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:45:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:45:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396303677',display_name='tempest-VolumesAdminNegativeTest-server-1396303677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396303677',id=14,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-tgu3y12g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:45:04Z,user_data=None,user_id='97d6d0ff7eee41559a923dfafce80855',uuid=efcb41f7-3b96-4afc-b6f3-b4a21fd6b753,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'pci_devices' on Instance uuid efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:45:06 user nova-compute[72620]:   <uuid>efcb41f7-3b96-4afc-b6f3-b4a21fd6b753</uuid>
Aug 09 20:45:06 user nova-compute[72620]:   <name>instance-0000000e</name>
Aug 09 20:45:06 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:45:06 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:45:06 user nova-compute[72620]:   <metadata>
Aug 09 20:45:06 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:45:06 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1396303677</nova:name>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:45:06</nova:creationTime>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:45:06 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:45:06 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:owner>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:user uuid="97d6d0ff7eee41559a923dfafce80855">tempest-VolumesAdminNegativeTest-1213195220-project-member</nova:user>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:project uuid="8904bc2939444f9a9270c2b48043bc6e">tempest-VolumesAdminNegativeTest-1213195220</nova:project>
Aug 09 20:45:06 user nova-compute[72620]:       </nova:owner>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:45:06 user nova-compute[72620]:       <nova:ports>
Aug 09 20:45:06 user nova-compute[72620]:         <nova:port uuid="e4e3a9d6-32af-45ee-b55f-b97c2070c456">
Aug 09 20:45:06 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 20:45:06 user nova-compute[72620]:         </nova:port>
Aug 09 20:45:06 user nova-compute[72620]:       </nova:ports>
Aug 09 20:45:06 user nova-compute[72620]:     </nova:instance>
Aug 09 20:45:06 user nova-compute[72620]:   </metadata>
Aug 09 20:45:06 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:45:06 user nova-compute[72620]:     <system>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="serial">efcb41f7-3b96-4afc-b6f3-b4a21fd6b753</entry>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="uuid">efcb41f7-3b96-4afc-b6f3-b4a21fd6b753</entry>
Aug 09 20:45:06 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:45:06 user nova-compute[72620]:     </system>
Aug 09 20:45:06 user nova-compute[72620]:   </sysinfo>
Aug 09 20:45:06 user nova-compute[72620]:   <os>
Aug 09 20:45:06 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:45:06 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:45:06 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:45:06 user nova-compute[72620]:   </os>
Aug 09 20:45:06 user nova-compute[72620]:   <features>
Aug 09 20:45:06 user nova-compute[72620]:     <acpi/>
Aug 09 20:45:06 user nova-compute[72620]:     <apic/>
Aug 09 20:45:06 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:45:06 user nova-compute[72620]:   </features>
Aug 09 20:45:06 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:45:06 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:45:06 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:45:06 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:45:06 user nova-compute[72620]:   </clock>
Aug 09 20:45:06 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:45:06 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:45:06 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:45:06 user nova-compute[72620]:   </cpu>
Aug 09 20:45:06 user nova-compute[72620]:   <devices>
Aug 09 20:45:06 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:45:06 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:45:06 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk"/>
Aug 09 20:45:06 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:45:06 user nova-compute[72620]:     </disk>
Aug 09 20:45:06 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:45:06 user nova-compute[72620]:       <mac address="fa:16:3e:cc:a6:1c"/>
Aug 09 20:45:06 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:45:06 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:45:06 user nova-compute[72620]:       <target dev="tape4e3a9d6-32"/>
Aug 09 20:45:06 user nova-compute[72620]:     </interface>
Aug 09 20:45:06 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:45:06 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/console.log" append="off"/>
Aug 09 20:45:06 user nova-compute[72620]:     </serial>
Aug 09 20:45:06 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:45:06 user nova-compute[72620]:     <video>
Aug 09 20:45:06 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:45:06 user nova-compute[72620]:     </video>
Aug 09 20:45:06 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:45:06 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:45:06 user nova-compute[72620]:     </rng>
Aug 09 20:45:06 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:45:06 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:45:06 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:45:06 user nova-compute[72620]:     </memballoon>
Aug 09 20:45:06 user nova-compute[72620]:   </devices>
Aug 09 20:45:06 user nova-compute[72620]: </domain>
Aug 09 20:45:06 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396303677',display_name='tempest-VolumesAdminNegativeTest-server-1396303677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396303677',id=14,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-tgu3y12g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:45:04Z,user_data=None,user_id='97d6d0ff7eee41559a923dfafce80855',uuid=efcb41f7-3b96-4afc-b6f3-b4a21fd6b753,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG os_vif [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4e3a9d6-32, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4e3a9d6-32, col_values=(('external_ids', {'iface-id': 'e4e3a9d6-32af-45ee-b55f-b97c2070c456', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a6:1c', 'vm-uuid': 'efcb41f7-3b96-4afc-b6f3-b4a21fd6b753'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:06 user nova-compute[72620]: INFO os_vif [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32')
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] No VIF found with MAC fa:16:3e:cc:a6:1c, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] Acquiring lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] No waiting events found dispatching network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:06 user nova-compute[72620]: WARNING nova.compute.manager [req-75deac37-fe8a-4566-ab75-bdc804977a8f req-8466a75f-8fd1-4c75-b468-c661536714e4 service nova] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Received unexpected event network-vif-plugged-6db33a86-8c64-4493-8db3-bf494a12dbf4 for instance with vm_state deleted and task_state None.
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.581s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Updated VIF entry in instance network info cache for port e4e3a9d6-32af-45ee-b55f-b97c2070c456. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Updating instance_info_cache with network_info: [{"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:06 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Deleted allocations for instance 4ae767ef-9a76-40a8-8f7c-6f126c99af14
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a8991bc-dc23-4271-86b1-eb55d4788fb5 req-de6359c4-5607-4f07-8059-57ba421b0d5f service nova] Releasing lock "refresh_cache-efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c41cf4-c56c-4071-97af-9a472de5eed9 tempest-TaggedBootDevicesTest-367732195 tempest-TaggedBootDevicesTest-367732195-project-member] Lock "4ae767ef-9a76-40a8-8f7c-6f126c99af14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.200s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:07 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Deleted allocations for instance 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c
Aug 09 20:45:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7f26abbe-6ba5-4680-9304-be39fcfc343e tempest-VolumesAssistedSnapshotsTest-326438208 tempest-VolumesAssistedSnapshotsTest-326438208-project-member] Lock "1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] No waiting events found dispatching network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:08 user nova-compute[72620]: WARNING nova.compute.manager [req-4c8b7470-5ce0-4d25-a08e-63fb107783a8 req-8382c30f-241f-409f-bf6b-5376ebb3d47a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received unexpected event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 for instance with vm_state building and task_state spawning.
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613910.0276923, efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] VM Resumed (Lifecycle Event)
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Instance spawned successfully.
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613910.0323527, efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] VM Started (Lifecycle Event)
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:10 user nova-compute[72620]: INFO nova.compute.manager [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Took 7.30 seconds to build instance.
Aug 09 20:45:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fb09b22a-5f78-4fc4-8317-226dd6c9db76 tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.406s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] No waiting events found dispatching network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:10 user nova-compute[72620]: WARNING nova.compute.manager [req-0d1f16b8-a3dc-4677-b078-d723dab8d25f req-b1ed719c-8043-4396-914e-af98e63c682c service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received unexpected event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 for instance with vm_state active and task_state None.
Aug 09 20:45:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:13 user nova-compute[72620]: INFO nova.compute.manager [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Terminating instance
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-unplugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-unplugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-bac21699-8b05-4600-970f-9dedd56316da req-61757738-2e08-4413-bd90-4811224a0593 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-unplugged-74aae613-71c2-43a4-8774-a3cc27def6e5 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Instance destroyed successfully.
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lazy-loading 'resources' on Instance uuid df2b7ed3-d447-46bc-9ef7-2edbe34d5883 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1620747692',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1620747692',id=10,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWEsOOaDlIycz+h3qsjheUGz9uLwHYAnj/7PdUNKJzZ59+9RMa9b138yoXZl8dAmEouVB5EIp5xJGE/na7fGcOvQioMNtGpccTZOmXECTrRsDIGMdRIXS0SfSRVNe9IKw==',key_name='tempest-keypair-450287394',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3baafdb5a61a44878847326c13daa6c9',ramdisk_id='',reservation_id='r-bxa7cnmx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1023541733',owner_user_name='tempest-TaggedAttachmentsTest-1023541733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88004f63268d4b889d25b8f51c825557',uuid=df2b7ed3-d447-46bc-9ef7-2edbe34d5883,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converting VIF {"id": "74aae613-71c2-43a4-8774-a3cc27def6e5", "address": "fa:16:3e:c3:e5:ba", "network": {"id": "e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-429207475-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3baafdb5a61a44878847326c13daa6c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74aae613-71", "ovs_interfaceid": "74aae613-71c2-43a4-8774-a3cc27def6e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG os_vif [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74aae613-71, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:13 user nova-compute[72620]: INFO os_vif [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:e5:ba,bridge_name='br-int',has_traffic_filtering=True,id=74aae613-71c2-43a4-8774-a3cc27def6e5,network=Network(e399b4b3-8f7a-4e24-b3c7-1c9eef524d5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74aae613-71')
Aug 09 20:45:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Deleting instance files /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883_del
Aug 09 20:45:13 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Deletion of /opt/stack/data/nova/instances/df2b7ed3-d447-46bc-9ef7-2edbe34d5883_del complete
Aug 09 20:45:14 user nova-compute[72620]: INFO nova.compute.manager [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Took 1.07 seconds to destroy the instance on the hypervisor.
Aug 09 20:45:14 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:45:14 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:45:14 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] Acquiring lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] No waiting events found dispatching network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:15 user nova-compute[72620]: WARNING nova.compute.manager [req-dc09d5fb-ab9f-4140-881b-e712ecfcb542 req-1379fb57-b9f9-4295-abf2-9061418b3030 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received unexpected event network-vif-plugged-74aae613-71c2-43a4-8774-a3cc27def6e5 for instance with vm_state active and task_state deleting.
Aug 09 20:45:15 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:15 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Took 1.69 seconds to deallocate network for instance.
Aug 09 20:45:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:16 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Deleted allocations for instance df2b7ed3-d447-46bc-9ef7-2edbe34d5883
Aug 09 20:45:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b0125259-9d2f-4e8d-ac30-52109c87d1ff tempest-TaggedAttachmentsTest-1023541733 tempest-TaggedAttachmentsTest-1023541733-project-member] Lock "df2b7ed3-d447-46bc-9ef7-2edbe34d5883" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'flavor' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:17 user nova-compute[72620]: INFO nova.compute.manager [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Attaching volume 29c9f7db-f4ad-42b5-9765-0504d3952cdf to /dev/vdb
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.utils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0805a781-3d4f-4886-815f-138ca42d9562]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc45823-6f94-4bd5-9fe5-3e54b4c3571c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c0fb8c-b5dd-4184-a481-2dc77db996c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e32d93-d835-41e2-b9cd-f1cdfae85dd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:45:17 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:45:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc32f8f-0376-4102-95c7-23d967e99601]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG os_brick.utils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating existing volume attachment record: b134cd4c-f011-49c2-841d-148e6b94b78f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-4123870f-708a-4400-ad32-f718af667f97 req-a13e3133-85ef-4eda-911a-31eec77f0068 service nova] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Received event network-vif-deleted-74aae613-71c2-43a4-8774-a3cc27def6e5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:19 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613904.7472525, 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:19 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] VM Stopped (Lifecycle Event)
Aug 09 20:45:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-443dfaa5-180c-4fb5-b69e-07a6743910b3 None None] [instance: 1e8fbf82-18da-44b1-8cb2-9bdd6f3d8e1c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'flavor' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:21 user nova-compute[72620]: INFO nova.compute.manager [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attaching volume 6af5d637-9584-42f7-88e8-e0419de03c67 to /dev/vdb
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.utils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5219ff03-12ad-433e-8b7e-5b3028c7dfc3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f327079-daaa-431f-a9d9-3d72104cf620]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af032fd8-b5b1-420d-bc9e-2ec5afe1f4d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a839f1-700d-41e8-96d7-903b9334567b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:45:21 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:45:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f750824-5ee1-4f72-8935-4178a4b1382e]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG os_brick.utils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating existing volume attachment record: 53c4ace4-4ba5-4c67-99e2-b3b211553887 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:45:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-changed-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing instance network info cache due to event network-changed-d9d7bc65-5b10-426a-90d6-5936196c1bc8. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] Acquiring lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] Acquired lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Refreshing network info cache for port d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:45:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updated VIF entry in instance network info cache for port d9d7bc65-5b10-426a-90d6-5936196c1bc8. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:45:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-274b4300-928e-4438-bfdd-e2958cbeedda req-0fe40b4a-255e-4cba-823a-e8cbaf4b88ca service nova] Releasing lock "refresh_cache-2ab68ec3-a65c-490b-9cc0-23d20f358dbe" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:26 user nova-compute[72620]: INFO nova.compute.manager [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Terminating instance
Aug 09 20:45:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:45:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-80781765-dfc0-42a7-9e74-f731bd524c27 req-af2a98cf-3204-446b-9132-39750e7f7aee service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-072080c6-dbd0-4fd8-9b31-28dd4d9b3e13 req-715474cf-8682-43f7-8406-979f652e8c14 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Instance destroyed successfully.
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lazy-loading 'resources' on Instance uuid 2ab68ec3-a65c-490b-9cc0-23d20f358dbe {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9d7bc65-5b, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=d9d7bc65-5b10-426a-90d6-5936196c1bc8,network=Network(a0cc093d-c62e-4398-b2a4-3aab4844f2a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d7bc65-5b')
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2ffa79-b7, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:67:85,bridge_name='br-int',has_traffic_filtering=True,id=3f2ffa79-b786-478a-97c3-5018e4ed7f20,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3f2ffa79-b7')
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06121608-d3, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4f:87,bridge_name='br-int',has_traffic_filtering=True,id=06121608-d3a0-4a53-912a-0055f1930602,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap06121608-d3')
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4565ef5a-7d, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613913.9391813, df2b7ed3-d447-46bc-9ef7-2edbe34d5883 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:28 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] VM Stopped (Lifecycle Event)
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:ee:54,bridge_name='br-int',has_traffic_filtering=True,id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4565ef5a-7d')
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b761d22b-5bbe-468c-858e-7036f734d339 None None] [instance: df2b7ed3-d447-46bc-9ef7-2edbe34d5883] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap189aee1c-df, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c0:24,bridge_name='br-int',has_traffic_filtering=True,id=189aee1c-dfca-4faf-b429-f6295ce1aad1,network=Network(ac369296-5af4-4354-9375-bf2d297bcd9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189aee1c-df')
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap663ab630-18, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f3:55,bridge_name='br-int',has_traffic_filtering=True,id=663ab630-1868-462c-af3e-a5ebcb00f2e0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap663ab630-18')
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-09T20:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-733495258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-733495258',id=11,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFBKNYRuvzpBKuAhHhUu6xy5MAMEJMwFPJEl50P8QP8WeqLSGNOLQwrLaSlsWafGRhRdQQDvnIkQYJPXlmuEBh09FskE/QvofyLwi+bYoFj8rbubCCNRwML0/9Btm7uxA==',key_name='tempest-keypair-1304302173',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed2dfa986c1b404fbbe239a5741d45f3',ramdisk_id='',reservation_id='r-2fo5wy9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2010398884',owner_user_name='tempest-TaggedBootDevicesTest_v242-2010398884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='de4e8ecaefce4518acfdcec05cd08f6b',uuid=2ab68ec3-a65c-490b-9cc0-23d20f358dbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converting VIF {"id": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "address": "fa:16:3e:8e:2e:da", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4eeb5103-c0", "ovs_interfaceid": "4eeb5103-c09c-4acd-b95d-5c3f78869cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4eeb5103-c0, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:45:29 user nova-compute[72620]: INFO os_vif [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:2e:da,bridge_name='br-int',has_traffic_filtering=True,id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0,network=Network(9bc361c9-645b-4153-9d89-9580fbebb3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4eeb5103-c0')
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVAwFcXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4b74e-e610-4b48-a9ea-010bb40d5e62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0723eb5-9190-4ab7-a4bc-41b4661adce2]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305a1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe3daae-4d36-46dc-b4fd-d3ef834793e2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d786f33-5804-4206-9920-9d6f15349c3d]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d642449-4088-42d5-9349-1ab322231669]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7b07cd-9138-4f5e-a648-de4ea9e269a0]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775415a-12fa-45a7-99c2-c8ad77015c17]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8eb109-0d54-4837-959a-1b8550162fff]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260]
Aug 09 20:45:29 user nova-compute[72620]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b6e722-df92-4b44-9417-741face61187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c546e694-49a6-4169-80ea-250645db1743]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== disconnect_volume: return (300ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IHfEepjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6451ca-8859-48ac-9ef9-daedc0d0f962]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[19559532-8eb6-4eb0-9f4b-a28281b4b56b]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb (non-flash)
Aug 09 20:45:29 user nova-compute[72620]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c503cfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb'): ({'sdf'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Removing single pathed devices sdf {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1d545d-ed99-4e21-ac40-0152b25b6da0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-d9d7bc65-5b10-426a-90d6-5936196c1bc8 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-189aee1c-dfca-4faf-b429-f6295ce1aad1 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-b68088c0-7ba4-459a-8413-301e3bc57368 req-6a186cf8-4596-4e50-a2ec-7b4e9b9a871d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[355ca9f3-57c8-4016-9c42-11fdc882a4e3]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Flushing IO for device /dev/sdf {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0fa13-d1a9-44ca-b7f1-73b5296e1e85]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9445666-755c-4a26-b6bb-ca069507c41f]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16448e-0a43-4744-9582-e2e079c4812e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff5d77-ea88-48b1-bf5e-3bc003e0f4cf]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260]
Aug 09 20:45:29 user nova-compute[72620]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e2d921c-4401-4f77-89ff-9e718d5096bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b2cfb-bfcc-4d61-acde-3ac1ed1f84a9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== disconnect_volume: return (312ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDTNjoXy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c58826-5625-4cf1-99b5-9e1d2cdbd517]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-3f2ffa79-b786-478a-97c3-5018e4ed7f20 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-06121608-d3a0-4a53-912a-0055f1930602 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-06121608-d3a0-4a53-912a-0055f1930602 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-4565ef5a-7dac-4cab-b1db-a866e5b6b27e for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-unplugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-unplugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Acquiring lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] No waiting events found dispatching network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:29 user nova-compute[72620]: WARNING nova.compute.manager [req-33b3e65f-2ae1-40a8-ae4f-d7abf6475879 req-6ea74a94-c89c-48e8-98f9-ef34ea2553dd service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received unexpected event network-vif-plugged-663ab630-1868-462c-af3e-a5ebcb00f2e0 for instance with vm_state active and task_state deleting.
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61e7fd-d4a7-4df3-869b-fbdc7874453c]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef (non-flash)
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3058a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef'): ({'sdg'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Removing single pathed devices sdg {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a5e29-297b-4c5b-bbab-e00e2f7fdbe5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[409da0f0-53ba-466d-ba6c-294eb9d2eb0f]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Flushing IO for device /dev/sdg {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d7b28a-8457-42ce-bdec-29b866589e02]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[02821975-cf40-448f-8451-52a3730f3112]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f695aec-6938-4294-a998-7328aafdbbc2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[429bede8-0d64-4ba4-b456-5edfdaa5b40f]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260]
Aug 09 20:45:29 user nova-compute[72620]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e619b635-af14-4b99-a6af-6ea1f97eceef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1857eed1-f74b-4b79-8b7f-72fd1a8aeaa1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] <== disconnect_volume: return (282ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:45:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Deleting instance files /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe_del
Aug 09 20:45:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Deletion of /opt/stack/data/nova/instances/2ab68ec3-a65c-490b-9cc0-23d20f358dbe_del complete
Aug 09 20:45:30 user nova-compute[72620]: INFO nova.compute.manager [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Took 3.16 seconds to destroy the instance on the hypervisor.
Aug 09 20:45:30 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:45:30 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:45:30 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:45:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-81f53e08-c938-4afe-8204-3aea0dd341d9 req-f90b0075-e6fd-46b7-915e-fa9a1f35404a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-deleted-4eeb5103-c09c-4acd-b95d-5c3f78869cb0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:32 user nova-compute[72620]: INFO nova.compute.manager [req-81f53e08-c938-4afe-8204-3aea0dd341d9 req-f90b0075-e6fd-46b7-915e-fa9a1f35404a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Neutron deleted interface 4eeb5103-c09c-4acd-b95d-5c3f78869cb0; detaching it from the instance and deleting it from the info cache
Aug 09 20:45:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-81f53e08-c938-4afe-8204-3aea0dd341d9 req-f90b0075-e6fd-46b7-915e-fa9a1f35404a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "address": "fa:16:3e:f5:c0:24", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189aee1c-df", "ovs_interfaceid": "189aee1c-dfca-4faf-b429-f6295ce1aad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-81f53e08-c938-4afe-8204-3aea0dd341d9 req-f90b0075-e6fd-46b7-915e-fa9a1f35404a service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Detach interface failed, port_id=4eeb5103-c09c-4acd-b95d-5c3f78869cb0, reason: Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-deleted-189aee1c-dfca-4faf-b429-f6295ce1aad1 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:34 user nova-compute[72620]: INFO nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Neutron deleted interface 189aee1c-dfca-4faf-b429-f6295ce1aad1; detaching it from the instance and deleting it from the info cache
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "address": "fa:16:3e:d5:f3:55", "network": {"id": "9bc361c9-645b-4153-9d89-9580fbebb3aa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1624152790", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap663ab630-18", "ovs_interfaceid": "663ab630-1868-462c-af3e-a5ebcb00f2e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Detach interface failed, port_id=189aee1c-dfca-4faf-b429-f6295ce1aad1, reason: Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-deleted-663ab630-1868-462c-af3e-a5ebcb00f2e0 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:34 user nova-compute[72620]: INFO nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Neutron deleted interface 663ab630-1868-462c-af3e-a5ebcb00f2e0; detaching it from the instance and deleting it from the info cache
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "address": "fa:16:3e:db:ee:54", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4565ef5a-7d", "ovs_interfaceid": "4565ef5a-7dac-4cab-b1db-a866e5b6b27e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Detach interface failed, port_id=663ab630-1868-462c-af3e-a5ebcb00f2e0, reason: Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-deleted-4565ef5a-7dac-4cab-b1db-a866e5b6b27e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:34 user nova-compute[72620]: INFO nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Neutron deleted interface 4565ef5a-7dac-4cab-b1db-a866e5b6b27e; detaching it from the instance and deleting it from the info cache
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [{"id": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "address": "fa:16:3e:c2:9b:17", "network": {"id": "a0cc093d-c62e-4398-b2a4-3aab4844f2a9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1425400596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d7bc65-5b", "ovs_interfaceid": "d9d7bc65-5b10-426a-90d6-5936196c1bc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "address": "fa:16:3e:7d:67:85", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2ffa79-b7", "ovs_interfaceid": "3f2ffa79-b786-478a-97c3-5018e4ed7f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "06121608-d3a0-4a53-912a-0055f1930602", "address": "fa:16:3e:ec:4f:87", "network": {"id": "ac369296-5af4-4354-9375-bf2d297bcd9d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1311474954", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ed2dfa986c1b404fbbe239a5741d45f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06121608-d3", "ovs_interfaceid": "06121608-d3a0-4a53-912a-0055f1930602", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-d84d788f-b3fb-4707-a530-e56097f6f64b req-274808e7-a4d4-4987-b05c-1f704522f306 service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Detach interface failed, port_id=4565ef5a-7dac-4cab-b1db-a866e5b6b27e, reason: Instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:35 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Took 5.01 seconds to deallocate network for instance.
Aug 09 20:45:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:35 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61563f3-91ee-43ad-8d9e-3d8f2b433dc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:45:35 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262e294-aa4f-48fa-a498-f6dc35a75d19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67] added
Aug 09 20:45:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5125a1c3-e45e-47ac-95aa-1e6ceafbae56]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158fea0-796f-49b4-8c26-e90df1161042]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laZOkLzi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laZOkLzi" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6c26c-9194-4e93-847e-376eda00de4a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laZOkLzi'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a940fb65-5880-4692-a269-328787a6eafa]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0daab91-5c0c-4fa9-a3c1-384d64673576]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:45:35 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 20:45:35 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 20:45:35 user nova-compute[72620]: 
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3afc245-26c9-4b7b-92e1-238326b162db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260]
Aug 09 20:45:35 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704f678-a6c1-40d6-9b0b-1b4d941e27e3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b5bb9-f252-4995-9b11-48e337fb0a1c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5af5bc-1f3f-4af4-ae9e-147d33748490]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-3af58a8c-5a0a-42ad-a94e-a02b54e51a2c req-8d75ff15-c4a5-4e68-959f-848a59bd954d service nova] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Received event network-vif-deleted-d9d7bc65-5b10-426a-90d6-5936196c1bc8 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23337326339323730', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337326339323730', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG nova.objects.instance [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'flavor' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:45:36 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:45:36 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 20:45:36 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:45:36 user nova-compute[72620]:   <serial>6af5d637-9584-42f7-88e8-e0419de03c67</serial>
Aug 09 20:45:36 user nova-compute[72620]: </disk>
Aug 09 20:45:36 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:45:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No VIF found with MAC fa:16:3e:80:ec:0d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:45:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-981f5cef-6977-4551-b6cb-7af6c404e539 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.394s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:38 user nova-compute[72620]: INFO nova.compute.manager [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Took 2.98 seconds to detach 3 volumes for instance.
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:38 user nova-compute[72620]: INFO nova.compute.manager [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Rescuing
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG nova.network.neutron [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:38 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Deleted allocations for instance 2ab68ec3-a65c-490b-9cc0-23d20f358dbe
Aug 09 20:45:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1497a121-2927-4680-8630-508787145c01 tempest-TaggedBootDevicesTest_v242-2010398884 tempest-TaggedBootDevicesTest_v242-2010398884-project-member] Lock "2ab68ec3-a65c-490b-9cc0-23d20f358dbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.790s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:39 user nova-compute[72620]: WARNING nova.compute.manager [req-eb865f99-2299-4f9f-a471-98782557773f req-9724e4e3-53ab-4350-9ea9-7c85b3679b25 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state active and task_state rescuing.
Aug 09 20:45:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance destroyed successfully.
Aug 09 20:45:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attempting a stable device rescue
Aug 09 20:45:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:45:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Creating image(s)
Aug 09 20:45:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'trusted_certs' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "195483999140cf25ca4da146ad7c2b60195b0adb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "195483999140cf25ca4da146ad7c2b60195b0adb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:41 user nova-compute[72620]: WARNING nova.compute.manager [req-2352e287-c29c-49a2-b57b-92104727bf6e req-34f2af5e-6042-4760-90b9-34534e7decfe service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state active and task_state rescuing.
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.part --force-share --output=json" returned: 0 in 0.187s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG nova.virt.images [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] 795793df-6bde-4e79-9994-2dabd20fc3d1 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:45:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.part /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.part /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.converted" returned: 0 in 0.575s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "195483999140cf25ca4da146ad7c2b60195b0adb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.294s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "195483999140cf25ca4da146ad7c2b60195b0adb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "195483999140cf25ca4da146ad7c2b60195b0adb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb --force-share --output=json" returned: 0 in 0.187s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb,backing_fmt=raw /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb,backing_fmt=raw /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "195483999140cf25ca4da146ad7c2b60195b0adb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'migration_context' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start _get_guest_xml network_info=[{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "vif_mac": "fa:16:3e:80:ec:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '795793df-6bde-4e79-9994-2dabd20fc3d1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '126f0a38-2bd7-4258-bf85-86bfb9c6d4b0', 'attached_at': '', 'detached_at': '', 'volume_id': '6af5d637-9584-42f7-88e8-e0419de03c67', 'serial': '6af5d637-9584-42f7-88e8-e0419de03c67'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '53c4ace4-4ba5-4c67-99e2-b3b211553887', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'resources' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'numa_topology' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:42 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:45:42 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:45:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'vcpu_model' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:43 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:43 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:43 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42a83ac-1881-49f2-a205-3f87c4e874aa]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = laZOkLzi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 20:45:43 user nova-compute[72620]: node.name = iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67
Aug 09 20:45:43 user nova-compute[72620]: node.tpgt = -1
Aug 09 20:45:43 user nova-compute[72620]: node.startup = automatic
Aug 09 20:45:43 user nova-compute[72620]: node.leading_login = No
Aug 09 20:45:43 user nova-compute[72620]: iface.iscsi_ifacename = default
Aug 09 20:45:43 user nova-compute[72620]: iface.net_ifacename = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.ipaddress = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.prefix_len = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.hwaddress = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.transport_name = tcp
Aug 09 20:45:43 user nova-compute[72620]: iface.initiatorname = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.vlan_id = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.vlan_priority = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.vlan_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.iface_num = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.mtu = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.port = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.bootproto = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.subnet_mask = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.gateway = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_alt_client_id = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_dns = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_learn_iqn = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_vendor_id_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_vendor_id = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.dhcp_slp_da = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.fragmentation = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.gratuitous_arp = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.incoming_forwarding = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.tos_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.tos = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.ttl = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.delayed_ack = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.tcp_nagle = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.tcp_wsf_state = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.tcp_wsf = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.tcp_timer_scale = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.tcp_timestamp = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.redirect = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.def_task_mgmt_timeout = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.header_digest = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.data_digest = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.immediate_data = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.initial_r2t = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.data_seq_inorder = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.data_pdu_inorder = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.erl = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.max_receive_data_len = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.first_burst_len = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.max_outstanding_r2t = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.max_burst_len = 0
Aug 09 20:45:43 user nova-compute[72620]: iface.chap_auth = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.bidi_chap = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.strict_login_compliance = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.discovery_auth = <empty>
Aug 09 20:45:43 user nova-compute[72620]: iface.discovery_logout = <empty>
Aug 09 20:45:43 user nova-compute[72620]: node.discovery_address = <empty>
Aug 09 20:45:43 user nova-compute[72620]: node.discovery_port = 0
Aug 09 20:45:43 user nova-compute[72620]: node.discovery_type = static
Aug 09 20:45:43 user nova-compute[72620]: node.session.initial_cmdsn = 0
Aug 09 20:45:43 user nova-compute[72620]: node.session.initial_login_retry_max = 8
Aug 09 20:45:43 user nova-compute[72620]: node.session.xmit_thread_priority = -20
Aug 09 20:45:43 user nova-compute[72620]: node.session.cmds_max = 128
Aug 09 20:45:43 user nova-compute[72620]: node.session.queue_depth = 32
Aug 09 20:45:43 user nova-compute[72620]: node.session.nr_sessions = 1
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.authmethod = CHAP
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.username = laZOkLzi
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.password = ***
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.username_in = <empty>
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.password_in = <empty>
Aug 09 20:45:43 user nova-compute[72620]: node.session.auth.chap_algs = MD5
Aug 09 20:45:43 user nova-compute[72620]: node.session.timeo.replacement_timeout = 120
Aug 09 20:45:43 user nova-compute[72620]: node.session.err_timeo.abort_timeout = 15
Aug 09 20:45:43 user nova-compute[72620]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 20:45:43 user nova-compute[72620]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 20:45:43 user nova-compute[72620]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.FastAbort = Yes
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.InitialR2T = No
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.ImmediateData = Yes
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.MaxConnections = 1
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 20:45:43 user nova-compute[72620]: node.session.iscsi.ERL = 0
Aug 09 20:45:43 user nova-compute[72620]: node.session.scan = manual
Aug 09 20:45:43 user nova-compute[72620]: node.session.reopen_max = 0
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].address = 172.16.0.220
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].port = 3260
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].startup = manual
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].tcp.window_size = 524288
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].tcp.type_of_service = 0
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].timeo.logout_timeout = 15
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].timeo.login_timeout = 15
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].timeo.auth_timeout = 45
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.DataDigest = None
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.IFMarker = No
Aug 09 20:45:43 user nova-compute[72620]: node.conn[0].iscsi.OFMarker = No
Aug 09 20:45:43 user nova-compute[72620]: # END RECORD
Aug 09 20:45:43 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[633af8a0-1d4b-4fb7-a298-4b5f80ebc362]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf18b34-42d8-4873-864b-f8b1cece0635]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laZOkLzi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laZOkLzi" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef07a5d-1a43-4f7c-a6a9-a4c8ac3aa9e8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laZOkLzi'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[650eb436-aa0a-4dc2-9d0e-314446569e3a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed52ba-236f-4de5-9a40-a9d73e03cd96]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:43 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:43 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5715f0-8b1a-4c3e-91e2-50644df30e89]: (4, ('0 0 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23337326339323730', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337326339323730', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-339600390',display_name='tempest-ServerStableDeviceRescueTest-server-339600390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-339600390',id=5,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDIw6JRw/5sN0nyPc1O6W4xx94shaFnrSQHNikVNokQNzxYCDxhmAEzzPD4xRuf9T/MZp8fxSDwJBAnTIo95pnqZa8PaZvnwuCpgVmloO1+hrXwWRISRIvajls220qrVg==',key_name='tempest-keypair-900329416',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af525394a7ce4d518ba31b48cc4de994',ramdisk_id='',reservation_id='r-o180qqf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-284578307',owner_user_name='tempest-ServerStableDeviceRescueTest-284578307-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:43:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03fddb657b24c97a984041ad12da65a',uuid=126f0a38-2bd7-4258-bf85-86bfb9c6d4b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "vif_mac": "fa:16:3e:80:ec:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converting VIF {"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "vif_mac": "fa:16:3e:80:ec:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'pci_devices' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:45:43 user nova-compute[72620]:   <uuid>126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</uuid>
Aug 09 20:45:43 user nova-compute[72620]:   <name>instance-00000005</name>
Aug 09 20:45:43 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:45:43 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:45:43 user nova-compute[72620]:   <metadata>
Aug 09 20:45:43 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:45:43 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-339600390</nova:name>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:45:42</nova:creationTime>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:45:43 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:45:43 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:owner>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:user uuid="e03fddb657b24c97a984041ad12da65a">tempest-ServerStableDeviceRescueTest-284578307-project-member</nova:user>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:project uuid="af525394a7ce4d518ba31b48cc4de994">tempest-ServerStableDeviceRescueTest-284578307</nova:project>
Aug 09 20:45:43 user nova-compute[72620]:       </nova:owner>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:45:43 user nova-compute[72620]:       <nova:ports>
Aug 09 20:45:43 user nova-compute[72620]:         <nova:port uuid="6510a428-7366-4a0b-8e14-0518304756c7">
Aug 09 20:45:43 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 20:45:43 user nova-compute[72620]:         </nova:port>
Aug 09 20:45:43 user nova-compute[72620]:       </nova:ports>
Aug 09 20:45:43 user nova-compute[72620]:     </nova:instance>
Aug 09 20:45:43 user nova-compute[72620]:   </metadata>
Aug 09 20:45:43 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:45:43 user nova-compute[72620]:     <system>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="serial">126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</entry>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="uuid">126f0a38-2bd7-4258-bf85-86bfb9c6d4b0</entry>
Aug 09 20:45:43 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:45:43 user nova-compute[72620]:     </system>
Aug 09 20:45:43 user nova-compute[72620]:   </sysinfo>
Aug 09 20:45:43 user nova-compute[72620]:   <os>
Aug 09 20:45:43 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:45:43 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:45:43 user nova-compute[72620]:   </os>
Aug 09 20:45:43 user nova-compute[72620]:   <features>
Aug 09 20:45:43 user nova-compute[72620]:     <acpi/>
Aug 09 20:45:43 user nova-compute[72620]:     <apic/>
Aug 09 20:45:43 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:45:43 user nova-compute[72620]:   </features>
Aug 09 20:45:43 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:45:43 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:45:43 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:45:43 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:45:43 user nova-compute[72620]:   </clock>
Aug 09 20:45:43 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:45:43 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:45:43 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:45:43 user nova-compute[72620]:   </cpu>
Aug 09 20:45:43 user nova-compute[72620]:   <devices>
Aug 09 20:45:43 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:45:43 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:45:43 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk"/>
Aug 09 20:45:43 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:45:43 user nova-compute[72620]:     </disk>
Aug 09 20:45:43 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:45:43 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:45:43 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 20:45:43 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:45:43 user nova-compute[72620]:       <serial>6af5d637-9584-42f7-88e8-e0419de03c67</serial>
Aug 09 20:45:43 user nova-compute[72620]:     </disk>
Aug 09 20:45:43 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:45:43 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:45:43 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue"/>
Aug 09 20:45:43 user nova-compute[72620]:       <target dev="vdc" bus="virtio"/>
Aug 09 20:45:43 user nova-compute[72620]:       <boot order="1"/>
Aug 09 20:45:43 user nova-compute[72620]:     </disk>
Aug 09 20:45:43 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:45:43 user nova-compute[72620]:       <mac address="fa:16:3e:80:ec:0d"/>
Aug 09 20:45:43 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:45:43 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:45:43 user nova-compute[72620]:       <target dev="tap6510a428-73"/>
Aug 09 20:45:43 user nova-compute[72620]:     </interface>
Aug 09 20:45:43 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:45:43 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/console.log" append="off"/>
Aug 09 20:45:43 user nova-compute[72620]:     </serial>
Aug 09 20:45:43 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:45:43 user nova-compute[72620]:     <video>
Aug 09 20:45:43 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:45:43 user nova-compute[72620]:     </video>
Aug 09 20:45:43 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:45:43 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:45:43 user nova-compute[72620]:     </rng>
Aug 09 20:45:43 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:45:43 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:45:43 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:45:43 user nova-compute[72620]:     </memballoon>
Aug 09 20:45:43 user nova-compute[72620]:   </devices>
Aug 09 20:45:43 user nova-compute[72620]: </domain>
Aug 09 20:45:43 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:45:43 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance destroyed successfully.
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] No VIF found with MAC fa:16:3e:80:ec:0d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613928.6828084, 2ab68ec3-a65c-490b-9cc0-23d20f358dbe => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:43 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] VM Stopped (Lifecycle Event)
Aug 09 20:45:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ead76463-f2b8-471b-8539-ab0b66f59f8d None None] [instance: 2ab68ec3-a65c-490b-9cc0-23d20f358dbe] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:44 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:44 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:44 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaade205-6754-4302-a097-472f5378c3d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:45:44 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05abb2-df15-461c-a2e5-2b9ee1cd66b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[973a845f-0b49-4e03-bc63-f77767d26fda]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b45ef8-92e0-4a53-b29d-21af77772dd7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4a28c4-947b-4891-946b-5126a9d6b5f0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPCQFNVG'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0999ea82-a85b-45a8-bd5c-7a75c357c6c1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb7cb3-bb98-4396-a4ee-d4bff42a4e44]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[070c9f73-c18e-4394-bf29-f974a2c6938d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:45:44 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[823c2dc2-355e-4a99-b964-909509ee86b7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae19e9ba-208f-49f9-962b-9ebd4597cd19]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:44 user nova-compute[72620]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:44 user nova-compute[72620]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:45:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ea7814-1036-4892-81ed-fbd4de635fc5]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:45 user nova-compute[72620]: WARNING nova.compute.manager [req-8bbb7413-9861-48d8-813b-34367c4e74c4 req-d93c74c4-d36e-40d4-8fcf-0369fbbd2ed5 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state active and task_state rescuing.
Aug 09 20:45:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'flavor' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:45:45 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:45:45 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:45:45 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:45:45 user nova-compute[72620]:   <serial>29c9f7db-f4ad-42b5-9765-0504d3952cdf</serial>
Aug 09 20:45:45 user nova-compute[72620]: </disk>
Aug 09 20:45:45 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:45:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:45:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No VIF found with MAC fa:16:3e:d5:05:b1, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:45:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a94a2c7a-ae95-4acc-9eea-a2abd62b3689 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.147s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:47 user nova-compute[72620]: WARNING nova.compute.manager [req-bd462177-f803-4656-a4be-b7fa3780df5e req-73a42f33-8036-4ddd-84e3-c608eaedebc8 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state active and task_state rescuing.
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613947.3840544, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:47 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Resumed (Lifecycle Event)
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-37886d77-1d95-4eb1-a905-342ecb2a2101 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613947.3874297, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:45:47 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Started (Lifecycle Event)
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:45:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:45:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Stashing vm_state: active {{(pid=72620) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 20:45:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'pci_requests' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:45:49 user nova-compute[72620]: INFO nova.compute.claims [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Claim successful on node user
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'resources' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'pci_devices' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:45:49 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating resource usage from migration a8790657-10e9-4dfd-9c2d-bf10a1503434
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.501s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:49 user nova-compute[72620]: INFO nova.compute.manager [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Migrating
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:49 user nova-compute[72620]: INFO nova.compute.rpcapi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Starting migrate_disk_and_power_off {{(pid=72620) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:50 user nova-compute[72620]: WARNING nova.compute.manager [req-a9285b3c-34cf-4c79-8ead-913d91a9d1e1 req-ef87c8f7-3d0f-4856-990b-8d4067ab8f22 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state resize_migrating.
Aug 09 20:45:51 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance destroyed successfully.
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:45:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdabb0b-cb, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:51 user nova-compute[72620]: INFO os_vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:45:51 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c790fd39-1481-4682-b477-177983ee29fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e99d0c-e0a7-46fb-9d65-5068bed6f613]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:51 user nova-compute[72620]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:45:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:45:51 user nova-compute[72620]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:45:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c50687ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd37323-641b-41e0-b17f-c709745a5a0a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[925d80e6-ef08-43b2-a70f-bf05fe5211a7]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[158204d4-dff7-416d-845d-973302257ee9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[10680c0d-758e-44ba-b0fe-9f21364eea07]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc6a02a-a6cc-45de-aeef-0401a91fc69e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f71045-55ad-459c-b9a0-a3cf62740d90]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:45:51 user nova-compute[72620]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:45:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e4b6db-f945-4799-9745-33814bb515cb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== disconnect_volume: return (320ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:45:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_resize/disk /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "cp -r /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_resize/disk /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk" returned: 0 in 0.439s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_resize/disk.info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk.info {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "cp -r /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_resize/disk.info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk.info" returned: 0 in 0.034s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:45:52 user nova-compute[72620]: WARNING nova.compute.manager [req-7b7ab2dd-eb24-4275-96fa-5c09aed4d49f req-94972961-06a6-4ac4-affa-b903797e59d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state resize_migrating.
Aug 09 20:45:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd binding to destination host user is already ACTIVE {{(pid=72620) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:45:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5ba276-a52d-4434-90d7-19b48c58c179]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ce48a-9b70-46f1-bfc5-6ff6a1a0a8f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[61120927-73c3-43ba-bc2b-f13987823351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0fb19e-d8a3-48fa-9882-e86937b94545]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:46:00 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:46:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e9a57c-9731-4450-93ed-e6551095ac49]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:46:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7798MB free_disk=25.51529312133789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Applying migration context for instance e96165b1-5eca-4530-821e-b00b66710ca1 as it has an incoming, in-progress migration a8790657-10e9-4dfd-9c2d-bf10a1503434. Migration status is post-migrating {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 20:46:05 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating resource usage from migration a8790657-10e9-4dfd-9c2d-bf10a1503434
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Migration a8790657-10e9-4dfd-9c2d-bf10a1503434 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:46:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:06 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691613951.2305493, e96165b1-5eca-4530-821e-b00b66710ca1 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:06 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Stopped (Lifecycle Event)
Aug 09 20:46:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-43555e78-eba3-4719-86b8-e5885d879810 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-43555e78-eba3-4719-86b8-e5885d879810 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:06 user nova-compute[72620]: INFO nova.compute.manager [None req-43555e78-eba3-4719-86b8-e5885d879810 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 20:46:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:09 user nova-compute[72620]: INFO nova.compute.manager [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Rescuing
Aug 09 20:46:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:46:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:11 user nova-compute[72620]: WARNING nova.compute.manager [req-c21a8aa8-432f-4274-8aa7-a0d4fa54038c req-65724b5a-d390-4d27-9dd4-99f1c0451836 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state rescuing.
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance destroyed successfully.
Aug 09 20:46:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Attempting rescue
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:46:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Creating image(s)
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'trusted_certs' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue" returned: 0 in 0.087s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start _get_guest_xml network_info=[{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:30:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'numa_topology' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:11 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:11 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:46:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'vcpu_model' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493500109',display_name='tempest-ServerRescueNegativeTestJSON-server-1493500109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493500109',id=1,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-rhv465p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:41:43Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=df3a42a3-a50e-48d0-8962-2f77d4dea766,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:30:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:30:3a:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.objects.instance [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:46:12 user nova-compute[72620]:   <uuid>df3a42a3-a50e-48d0-8962-2f77d4dea766</uuid>
Aug 09 20:46:12 user nova-compute[72620]:   <name>instance-00000001</name>
Aug 09 20:46:12 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:46:12 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:46:12 user nova-compute[72620]:   <metadata>
Aug 09 20:46:12 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:46:12 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1493500109</nova:name>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:46:11</nova:creationTime>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:46:12 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:46:12 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:owner>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:46:12 user nova-compute[72620]:       </nova:owner>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:46:12 user nova-compute[72620]:       <nova:ports>
Aug 09 20:46:12 user nova-compute[72620]:         <nova:port uuid="462bce5d-1459-44eb-8115-88087cc6ec6c">
Aug 09 20:46:12 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:46:12 user nova-compute[72620]:         </nova:port>
Aug 09 20:46:12 user nova-compute[72620]:       </nova:ports>
Aug 09 20:46:12 user nova-compute[72620]:     </nova:instance>
Aug 09 20:46:12 user nova-compute[72620]:   </metadata>
Aug 09 20:46:12 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:46:12 user nova-compute[72620]:     <system>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="serial">df3a42a3-a50e-48d0-8962-2f77d4dea766</entry>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="uuid">df3a42a3-a50e-48d0-8962-2f77d4dea766</entry>
Aug 09 20:46:12 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:46:12 user nova-compute[72620]:     </system>
Aug 09 20:46:12 user nova-compute[72620]:   </sysinfo>
Aug 09 20:46:12 user nova-compute[72620]:   <os>
Aug 09 20:46:12 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:46:12 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:46:12 user nova-compute[72620]:   </os>
Aug 09 20:46:12 user nova-compute[72620]:   <features>
Aug 09 20:46:12 user nova-compute[72620]:     <acpi/>
Aug 09 20:46:12 user nova-compute[72620]:     <apic/>
Aug 09 20:46:12 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:46:12 user nova-compute[72620]:   </features>
Aug 09 20:46:12 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:46:12 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:46:12 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:46:12 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:46:12 user nova-compute[72620]:   </clock>
Aug 09 20:46:12 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:46:12 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:46:12 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:46:12 user nova-compute[72620]:   </cpu>
Aug 09 20:46:12 user nova-compute[72620]:   <devices>
Aug 09 20:46:12 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:46:12 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:46:12 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue"/>
Aug 09 20:46:12 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:46:12 user nova-compute[72620]:     </disk>
Aug 09 20:46:12 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:46:12 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:46:12 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk"/>
Aug 09 20:46:12 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:46:12 user nova-compute[72620]:     </disk>
Aug 09 20:46:12 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:46:12 user nova-compute[72620]:       <mac address="fa:16:3e:30:3a:76"/>
Aug 09 20:46:12 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:12 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:46:12 user nova-compute[72620]:       <target dev="tap462bce5d-14"/>
Aug 09 20:46:12 user nova-compute[72620]:     </interface>
Aug 09 20:46:12 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:46:12 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/console.log" append="off"/>
Aug 09 20:46:12 user nova-compute[72620]:     </serial>
Aug 09 20:46:12 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:46:12 user nova-compute[72620]:     <video>
Aug 09 20:46:12 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:12 user nova-compute[72620]:     </video>
Aug 09 20:46:12 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:46:12 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:46:12 user nova-compute[72620]:     </rng>
Aug 09 20:46:12 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:46:12 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:46:12 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:46:12 user nova-compute[72620]:     </memballoon>
Aug 09 20:46:12 user nova-compute[72620]:   </devices>
Aug 09 20:46:12 user nova-compute[72620]: </domain>
Aug 09 20:46:12 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:46:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance destroyed successfully.
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:30:3a:76, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:13 user nova-compute[72620]: WARNING nova.compute.manager [req-116c0467-84ff-4fd4-bf3f-8c3445e81eab req-215355dc-f72e-430a-a5d7-8c11d57dd620 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state rescuing.
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:15 user nova-compute[72620]: WARNING nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state rescuing.
Aug 09 20:46:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:15 user nova-compute[72620]: WARNING nova.compute.manager [req-17d1478d-3e7b-40b2-8a86-ee490187b71a req-2bdaa98d-55c2-434e-81e4-d610f2de7f84 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state active and task_state rescuing.
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for df3a42a3-a50e-48d0-8962-2f77d4dea766 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613976.1406717, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Resumed (Lifecycle Event)
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-39ecbac9-7d10-4b38-9c80-7994a9688290 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613976.1454997, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:16 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Started (Lifecycle Event)
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Starting finish_migration {{(pid=72620) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:46:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Creating image(s)
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'trusted_certs' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.211s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk. size=21474836480 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk 21474836480 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk 21474836480" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Ensure instance console log exists: /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start _get_guest_xml network_info=[{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e96165b1-5eca-4530-821e-b00b66710ca1', 'attached_at': '2023-08-09T20:46:22.000000', 'detached_at': '', 'volume_id': '29c9f7db-f4ad-42b5-9765-0504d3952cdf', 'serial': '29c9f7db-f4ad-42b5-9765-0504d3952cdf'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '74bd2905-c141-4a78-87cb-b0541f2d78dc', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:46:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'vcpu_model' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:46:22 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:46:22 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:46:22 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bd3edf-b63a-4057-aaf4-9875fb6b49f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:46:22 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab0ddf9-be81-4101-8b7e-89ef723b30ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added
Aug 09 20:46:22 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80adf50-a81a-4501-baa9-6891ea4fd52e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee698f-84aa-4e32-84d1-73f4dcb1c555]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d32457-5605-497d-9980-83cdc852ed31]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPCQFNVG'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4647ede-f3ec-43d7-8266-4895c6bdf3d0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf300c3-df36-4245-b0fa-3b897dc40e39]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:46:22 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:46:22 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:46:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85d7ee-bf65-4f56-89bf-be6957477c7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:46:23 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:46:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c824011-6639-4613-b04d-f6e87094eccd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a63763-39d8-42eb-a3d0-5811b8e582e4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:46:23 user nova-compute[72620]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:46:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:46:23 user nova-compute[72620]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:46:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e8e53-e3f2-4b5e-ae83-de9e47061e1d]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:46:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:46:24 user nova-compute[72620]:   <uuid>e96165b1-5eca-4530-821e-b00b66710ca1</uuid>
Aug 09 20:46:24 user nova-compute[72620]:   <name>instance-00000004</name>
Aug 09 20:46:24 user nova-compute[72620]:   <memory>2097152</memory>
Aug 09 20:46:24 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:46:24 user nova-compute[72620]:   <metadata>
Aug 09 20:46:24 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:46:24 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherB-server-1923729587</nova:name>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:46:22</nova:creationTime>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:flavor name="m1.small">
Aug 09 20:46:24 user nova-compute[72620]:         <nova:memory>2048</nova:memory>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:disk>20</nova:disk>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:46:24 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:owner>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:user uuid="5346961c66f84f0cbc929b2de7d72485">tempest-ServerActionsTestOtherB-257906244-project-member</nova:user>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:project uuid="98aa07c3778141cfbf35d9fd26289d02">tempest-ServerActionsTestOtherB-257906244</nova:project>
Aug 09 20:46:24 user nova-compute[72620]:       </nova:owner>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:46:24 user nova-compute[72620]:       <nova:ports>
Aug 09 20:46:24 user nova-compute[72620]:         <nova:port uuid="dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd">
Aug 09 20:46:24 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 20:46:24 user nova-compute[72620]:         </nova:port>
Aug 09 20:46:24 user nova-compute[72620]:       </nova:ports>
Aug 09 20:46:24 user nova-compute[72620]:     </nova:instance>
Aug 09 20:46:24 user nova-compute[72620]:   </metadata>
Aug 09 20:46:24 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:46:24 user nova-compute[72620]:     <system>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="serial">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="uuid">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:46:24 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:46:24 user nova-compute[72620]:     </system>
Aug 09 20:46:24 user nova-compute[72620]:   </sysinfo>
Aug 09 20:46:24 user nova-compute[72620]:   <os>
Aug 09 20:46:24 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:46:24 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:46:24 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:46:24 user nova-compute[72620]:   </os>
Aug 09 20:46:24 user nova-compute[72620]:   <features>
Aug 09 20:46:24 user nova-compute[72620]:     <acpi/>
Aug 09 20:46:24 user nova-compute[72620]:     <apic/>
Aug 09 20:46:24 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:46:24 user nova-compute[72620]:   </features>
Aug 09 20:46:24 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:46:24 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:46:24 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:46:24 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:46:24 user nova-compute[72620]:   </clock>
Aug 09 20:46:24 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:46:24 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:46:24 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:46:24 user nova-compute[72620]:   </cpu>
Aug 09 20:46:24 user nova-compute[72620]:   <devices>
Aug 09 20:46:24 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:46:24 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:46:24 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk"/>
Aug 09 20:46:24 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:46:24 user nova-compute[72620]:     </disk>
Aug 09 20:46:24 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:46:24 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:46:24 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:46:24 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:46:24 user nova-compute[72620]:       <serial>29c9f7db-f4ad-42b5-9765-0504d3952cdf</serial>
Aug 09 20:46:24 user nova-compute[72620]:     </disk>
Aug 09 20:46:24 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:46:24 user nova-compute[72620]:       <mac address="fa:16:3e:d5:05:b1"/>
Aug 09 20:46:24 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:24 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:46:24 user nova-compute[72620]:       <target dev="tapdfdabb0b-cb"/>
Aug 09 20:46:24 user nova-compute[72620]:     </interface>
Aug 09 20:46:24 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:46:24 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/console.log" append="off"/>
Aug 09 20:46:24 user nova-compute[72620]:     </serial>
Aug 09 20:46:24 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:46:24 user nova-compute[72620]:     <video>
Aug 09 20:46:24 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:24 user nova-compute[72620]:     </video>
Aug 09 20:46:24 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:46:24 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:46:24 user nova-compute[72620]:     </rng>
Aug 09 20:46:24 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:46:24 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:46:24 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:46:24 user nova-compute[72620]:     </memballoon>
Aug 09 20:46:24 user nova-compute[72620]:   </devices>
Aug 09 20:46:24 user nova-compute[72620]: </domain>
Aug 09 20:46:24 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:41:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2066656026-network", "vif_mac": "fa:16:3e:d5:05:b1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG os_vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdabb0b-cb, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfdabb0b-cb, col_values=(('external_ids', {'iface-id': 'dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:05:b1', 'vm-uuid': 'e96165b1-5eca-4530-821e-b00b66710ca1'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:24 user nova-compute[72620]: INFO os_vif [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] No VIF found with MAC fa:16:3e:d5:05:b1, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:46:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:26 user nova-compute[72620]: WARNING nova.compute.manager [req-b054a00d-2540-4468-b2ab-e680da4adcdb req-be0097f0-d991-49fc-b5d0-3e6e05d7d1fa service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state resize_finish.
Aug 09 20:46:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:28 user nova-compute[72620]: WARNING nova.compute.manager [req-906d1c3f-1ebd-4d1a-878b-d218378b2241 req-e83c3884-7fb3-40be-8cd6-9f36e4a3b77f service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state resize_finish.
Aug 09 20:46:28 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613988.9882212, e96165b1-5eca-4530-821e-b00b66710ca1 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:28 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Resumed (Lifecycle Event)
Aug 09 20:46:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:46:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance running successfully.
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Failed to set time: agent not configured {{(pid=72620) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-82b3ecc3-4eac-4d64-9e72-d643d9bc927f tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] finish_migration finished successfully. {{(pid=72620) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691613988.9901905, e96165b1-5eca-4530-821e-b00b66710ca1 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Started (Lifecycle Event)
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 20:46:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:33 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:46:33 user nova-compute[72620]: INFO nova.compute.claims [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Claim successful on node user
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:46:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.policy [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b0bb7bc6434f0b81a7479269348a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47da24a245bc4b0e9eb5cb14adf689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:46:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Creating image(s)
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:34 user nova-compute[72620]: INFO nova.compute.manager [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] instance snapshotting
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Beginning live snapshot process
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk 1073741824" returned: 0 in 0.193s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Successfully created port: 33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.299s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Cannot resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'migration_context' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Ensure instance console log exists: /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json -f qcow2" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.159s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e.delta 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e.delta 1073741824" returned: 0 in 0.053s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Successfully updated port: 33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-changed-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Refreshing instance network info cache due to event network-changed-33d0fedc-a465-457a-959d-c054e1e8a0e4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:46:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] COPY block job progress, current cursor: 22478848 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance network_info: |[{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.neutron [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Refreshing network info cache for port 33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start _get_guest_xml network_info=[{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:46:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'pci_devices' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:46:37 user nova-compute[72620]:   <uuid>c5872c41-5db7-42aa-9145-108eec912a53</uuid>
Aug 09 20:46:37 user nova-compute[72620]:   <name>instance-0000000f</name>
Aug 09 20:46:37 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:46:37 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:46:37 user nova-compute[72620]:   <metadata>
Aug 09 20:46:37 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:46:37 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeTestJSON-server-1990795843</nova:name>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:46:37</nova:creationTime>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:46:37 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:46:37 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:owner>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:user uuid="e7b0bb7bc6434f0b81a7479269348a72">tempest-AttachVolumeTestJSON-12994001-project-member</nova:user>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:project uuid="47da24a245bc4b0e9eb5cb14adf689d6">tempest-AttachVolumeTestJSON-12994001</nova:project>
Aug 09 20:46:37 user nova-compute[72620]:       </nova:owner>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:46:37 user nova-compute[72620]:       <nova:ports>
Aug 09 20:46:37 user nova-compute[72620]:         <nova:port uuid="33d0fedc-a465-457a-959d-c054e1e8a0e4">
Aug 09 20:46:37 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:46:37 user nova-compute[72620]:         </nova:port>
Aug 09 20:46:37 user nova-compute[72620]:       </nova:ports>
Aug 09 20:46:37 user nova-compute[72620]:     </nova:instance>
Aug 09 20:46:37 user nova-compute[72620]:   </metadata>
Aug 09 20:46:37 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:46:37 user nova-compute[72620]:     <system>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="serial">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="uuid">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:46:37 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:46:37 user nova-compute[72620]:     </system>
Aug 09 20:46:37 user nova-compute[72620]:   </sysinfo>
Aug 09 20:46:37 user nova-compute[72620]:   <os>
Aug 09 20:46:37 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:46:37 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:46:37 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:46:37 user nova-compute[72620]:   </os>
Aug 09 20:46:37 user nova-compute[72620]:   <features>
Aug 09 20:46:37 user nova-compute[72620]:     <acpi/>
Aug 09 20:46:37 user nova-compute[72620]:     <apic/>
Aug 09 20:46:37 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:46:37 user nova-compute[72620]:   </features>
Aug 09 20:46:37 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:46:37 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:46:37 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:46:37 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:46:37 user nova-compute[72620]:   </clock>
Aug 09 20:46:37 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:46:37 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:46:37 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:46:37 user nova-compute[72620]:   </cpu>
Aug 09 20:46:37 user nova-compute[72620]:   <devices>
Aug 09 20:46:37 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:46:37 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:46:37 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk"/>
Aug 09 20:46:37 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:46:37 user nova-compute[72620]:     </disk>
Aug 09 20:46:37 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:46:37 user nova-compute[72620]:       <mac address="fa:16:3e:aa:60:d6"/>
Aug 09 20:46:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:37 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:46:37 user nova-compute[72620]:       <target dev="tap33d0fedc-a4"/>
Aug 09 20:46:37 user nova-compute[72620]:     </interface>
Aug 09 20:46:37 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:46:37 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/console.log" append="off"/>
Aug 09 20:46:37 user nova-compute[72620]:     </serial>
Aug 09 20:46:37 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:46:37 user nova-compute[72620]:     <video>
Aug 09 20:46:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:37 user nova-compute[72620]:     </video>
Aug 09 20:46:37 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:46:37 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:46:37 user nova-compute[72620]:     </rng>
Aug 09 20:46:37 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:46:37 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:46:37 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:46:37 user nova-compute[72620]:     </memballoon>
Aug 09 20:46:37 user nova-compute[72620]:   </devices>
Aug 09 20:46:37 user nova-compute[72620]: </domain>
Aug 09 20:46:37 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG os_vif [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33d0fedc-a4, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33d0fedc-a4, col_values=(('external_ids', {'iface-id': '33d0fedc-a465-457a-959d-c054e1e8a0e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:60:d6', 'vm-uuid': 'c5872c41-5db7-42aa-9145-108eec912a53'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:37 user nova-compute[72620]: INFO os_vif [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:46:37 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No VIF found with MAC fa:16:3e:aa:60:d6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updated VIF entry in instance network info cache for port 33d0fedc-a465-457a-959d-c054e1e8a0e4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6dd6cb7b-efda-41dd-8929-3c3626b91801 req-ef26c03d-4c39-41f1-b993-10945d860a2a service nova] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e.delta /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e.delta /opt/stack/data/nova/instances/snapshots/tmp30830xtt/3cf135025624429ca3d2c668e8953f5e" returned: 0 in 0.564s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Snapshot extracted, beginning image upload
Aug 09 20:46:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:39 user nova-compute[72620]: WARNING nova.compute.manager [req-abb6794e-66a1-44f4-b707-b5c8ba6ad06b req-99d45ce5-c286-4c5d-8d7b-093dadfe0aaf service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state building and task_state spawning.
Aug 09 20:46:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:41 user nova-compute[72620]: WARNING nova.compute.manager [req-0529ff5c-885a-406e-9b1d-9976929657dd req-32ad842b-750d-4c6a-afc0-ce634c31760c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state building and task_state spawning.
Aug 09 20:46:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614002.1335716, c5872c41-5db7-42aa-9145-108eec912a53 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Resumed (Lifecycle Event)
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance spawned successfully.
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614002.1356745, c5872c41-5db7-42aa-9145-108eec912a53 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Started (Lifecycle Event)
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Took 7.79 seconds to spawn the instance on the hypervisor.
Aug 09 20:46:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Snapshot image upload complete
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-24a63dd5-9510-488a-a0af-7e759f2821ec tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Took 7.62 seconds to snapshot the instance on the hypervisor.
Aug 09 20:46:42 user nova-compute[72620]: INFO nova.compute.manager [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Took 8.82 seconds to build instance.
Aug 09 20:46:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a5a9e996-2ead-4abc-9dca-dd75b48747cd tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.983s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:46:45 user nova-compute[72620]: INFO nova.compute.claims [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Claim successful on node user
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:46:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.policy [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124600caee0544d7bda3b84ef147de25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc5844e588194631a39dd86e03ab4f8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:46:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Creating image(s)
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "/opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "/opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "/opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.176s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk 1073741824" returned: 0 in 0.070s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Successfully created port: 6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Cannot resize image /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'migration_context' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Ensure instance console log exists: /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:47 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Successfully updated port: 6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquired lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-changed-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Refreshing instance network info cache due to event network-changed-6e0ba9d7-393f-4ce5-850e-ce72c67ed053. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] Acquiring lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating instance_info_cache with network_info: [{"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Releasing lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Instance network_info: |[{"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] Acquired lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Refreshing network info cache for port 6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Start _get_guest_xml network_info=[{"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:46:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1585148396',display_name='tempest-TestVolumeSwap-server-1585148396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1585148396',id=16,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiAVd5aaobHvWa8ajnwTjkXywGgw89H7sHAfz7um2ZLdEDAqnrc2HoOHJ0cR1iAYHwgfnbYoso2Oy+01V/1jfS/JdV7+EYn2NAZYR1zfUbBWHf03brn/f7iSq56YLDc+Q==',key_name='tempest-keypair-2122825614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc5844e588194631a39dd86e03ab4f8e',ramdisk_id='',reservation_id='r-zuk69g8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1615110503',owner_user_name='tempest-TestVolumeSwap-1615110503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124600caee0544d7bda3b84ef147de25',uuid=0549bece-50e4-414b-945c-1b7338d23a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converting VIF {"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.objects.instance [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'pci_devices' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:46:48 user nova-compute[72620]:   <uuid>0549bece-50e4-414b-945c-1b7338d23a8c</uuid>
Aug 09 20:46:48 user nova-compute[72620]:   <name>instance-00000010</name>
Aug 09 20:46:48 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:46:48 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:46:48 user nova-compute[72620]:   <metadata>
Aug 09 20:46:48 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:46:48 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:name>tempest-TestVolumeSwap-server-1585148396</nova:name>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:46:48</nova:creationTime>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:46:48 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:46:48 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:owner>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:user uuid="124600caee0544d7bda3b84ef147de25">tempest-TestVolumeSwap-1615110503-project-member</nova:user>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:project uuid="dc5844e588194631a39dd86e03ab4f8e">tempest-TestVolumeSwap-1615110503</nova:project>
Aug 09 20:46:48 user nova-compute[72620]:       </nova:owner>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:46:48 user nova-compute[72620]:       <nova:ports>
Aug 09 20:46:48 user nova-compute[72620]:         <nova:port uuid="6e0ba9d7-393f-4ce5-850e-ce72c67ed053">
Aug 09 20:46:48 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 09 20:46:48 user nova-compute[72620]:         </nova:port>
Aug 09 20:46:48 user nova-compute[72620]:       </nova:ports>
Aug 09 20:46:48 user nova-compute[72620]:     </nova:instance>
Aug 09 20:46:48 user nova-compute[72620]:   </metadata>
Aug 09 20:46:48 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:46:48 user nova-compute[72620]:     <system>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="serial">0549bece-50e4-414b-945c-1b7338d23a8c</entry>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="uuid">0549bece-50e4-414b-945c-1b7338d23a8c</entry>
Aug 09 20:46:48 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:46:48 user nova-compute[72620]:     </system>
Aug 09 20:46:48 user nova-compute[72620]:   </sysinfo>
Aug 09 20:46:48 user nova-compute[72620]:   <os>
Aug 09 20:46:48 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:46:48 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:46:48 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:46:48 user nova-compute[72620]:   </os>
Aug 09 20:46:48 user nova-compute[72620]:   <features>
Aug 09 20:46:48 user nova-compute[72620]:     <acpi/>
Aug 09 20:46:48 user nova-compute[72620]:     <apic/>
Aug 09 20:46:48 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:46:48 user nova-compute[72620]:   </features>
Aug 09 20:46:48 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:46:48 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:46:48 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:46:48 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:46:48 user nova-compute[72620]:   </clock>
Aug 09 20:46:48 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:46:48 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:46:48 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:46:48 user nova-compute[72620]:   </cpu>
Aug 09 20:46:48 user nova-compute[72620]:   <devices>
Aug 09 20:46:48 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:46:48 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:46:48 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk"/>
Aug 09 20:46:48 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:46:48 user nova-compute[72620]:     </disk>
Aug 09 20:46:48 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:46:48 user nova-compute[72620]:       <mac address="fa:16:3e:6e:cd:b8"/>
Aug 09 20:46:48 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:48 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:46:48 user nova-compute[72620]:       <target dev="tap6e0ba9d7-39"/>
Aug 09 20:46:48 user nova-compute[72620]:     </interface>
Aug 09 20:46:48 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:46:48 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/console.log" append="off"/>
Aug 09 20:46:48 user nova-compute[72620]:     </serial>
Aug 09 20:46:48 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:46:48 user nova-compute[72620]:     <video>
Aug 09 20:46:48 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:46:48 user nova-compute[72620]:     </video>
Aug 09 20:46:48 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:46:48 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:46:48 user nova-compute[72620]:     </rng>
Aug 09 20:46:48 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:46:48 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:46:48 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:46:48 user nova-compute[72620]:     </memballoon>
Aug 09 20:46:48 user nova-compute[72620]:   </devices>
Aug 09 20:46:48 user nova-compute[72620]: </domain>
Aug 09 20:46:48 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1585148396',display_name='tempest-TestVolumeSwap-server-1585148396',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1585148396',id=16,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiAVd5aaobHvWa8ajnwTjkXywGgw89H7sHAfz7um2ZLdEDAqnrc2HoOHJ0cR1iAYHwgfnbYoso2Oy+01V/1jfS/JdV7+EYn2NAZYR1zfUbBWHf03brn/f7iSq56YLDc+Q==',key_name='tempest-keypair-2122825614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc5844e588194631a39dd86e03ab4f8e',ramdisk_id='',reservation_id='r-zuk69g8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1615110503',owner_user_name='tempest-TestVolumeSwap-1615110503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:46:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124600caee0544d7bda3b84ef147de25',uuid=0549bece-50e4-414b-945c-1b7338d23a8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converting VIF {"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG os_vif [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e0ba9d7-39, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e0ba9d7-39, col_values=(('external_ids', {'iface-id': '6e0ba9d7-393f-4ce5-850e-ce72c67ed053', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:cd:b8', 'vm-uuid': '0549bece-50e4-414b-945c-1b7338d23a8c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:48 user nova-compute[72620]: INFO os_vif [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39')
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:46:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] No VIF found with MAC fa:16:3e:6e:cd:b8, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:46:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updated VIF entry in instance network info cache for port 6e0ba9d7-393f-4ce5-850e-ce72c67ed053. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:46:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating instance_info_cache with network_info: [{"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d65d5bb-6e42-45b8-b190-b1c6b44a7107 req-6c06dbd4-bc0c-4bdd-9a2c-dec2199718a2 service nova] Releasing lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] No waiting events found dispatching network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:50 user nova-compute[72620]: WARNING nova.compute.manager [req-76425fd9-3a93-4981-a1a6-76a15ab69150 req-0c0c1b0e-ce4f-4dcb-9f5e-8f5625af58b2 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received unexpected event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 for instance with vm_state building and task_state spawning.
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:46:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 20:46:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614012.3916886, 0549bece-50e4-414b-945c-1b7338d23a8c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] VM Resumed (Lifecycle Event)
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Instance spawned successfully.
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614012.391805, 0549bece-50e4-414b-945c-1b7338d23a8c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] VM Started (Lifecycle Event)
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] No waiting events found dispatching network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:46:52 user nova-compute[72620]: WARNING nova.compute.manager [req-86b400bf-ec29-4f9b-849e-cd9e6a6e6e10 req-2b301975-5e06-4137-8a64-8b7daebaa100 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received unexpected event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 for instance with vm_state building and task_state spawning.
Aug 09 20:46:52 user nova-compute[72620]: INFO nova.compute.manager [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Took 7.58 seconds to build instance.
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44c5e103-fc7a-46a4-8978-91932e7ae166 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.732s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 20:46:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:46:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:46:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:46:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:46:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:46:55 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:56 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:46:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:47:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7343MB free_disk=25.446025848388672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Applying migration context for instance e96165b1-5eca-4530-821e-b00b66710ca1 as it has an incoming, in-progress migration a8790657-10e9-4dfd-9c2d-bf10a1503434. Migration status is finished {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 20:47:01 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating resource usage from migration a8790657-10e9-4dfd-9c2d-bf10a1503434
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Migration a8790657-10e9-4dfd-9c2d-bf10a1503434 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 0549bece-50e4-414b-945c-1b7338d23a8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:47:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:02 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:47:02 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:47:02 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:47:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.173s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:04 user nova-compute[72620]: INFO nova.compute.manager [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Terminating instance
Aug 09 20:47:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-unplugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] No waiting events found dispatching network-vif-unplugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f4585e42-affe-497a-a277-1b3ea661a214 req-da9ed517-9b20-4f18-a2b3-1c45f8aee56e service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-unplugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Instance destroyed successfully.
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.objects.instance [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'resources' on Instance uuid efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1396303677',display_name='tempest-VolumesAdminNegativeTest-server-1396303677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1396303677',id=14,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:45:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-tgu3y12g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:45:10Z,user_data=None,user_id='97d6d0ff7eee41559a923dfafce80855',uuid=efcb41f7-3b96-4afc-b6f3-b4a21fd6b753,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "address": "fa:16:3e:cc:a6:1c", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e3a9d6-32", "ovs_interfaceid": "e4e3a9d6-32af-45ee-b55f-b97c2070c456", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG os_vif [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e3a9d6-32, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:47:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:05 user nova-compute[72620]: INFO os_vif [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a6:1c,bridge_name='br-int',has_traffic_filtering=True,id=e4e3a9d6-32af-45ee-b55f-b97c2070c456,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e3a9d6-32')
Aug 09 20:47:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Deleting instance files /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753_del
Aug 09 20:47:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Deletion of /opt/stack/data/nova/instances/efcb41f7-3b96-4afc-b6f3-b4a21fd6b753_del complete
Aug 09 20:47:06 user nova-compute[72620]: INFO nova.compute.manager [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Took 1.42 seconds to destroy the instance on the hypervisor.
Aug 09 20:47:06 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:47:06 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:47:06 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:47:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] Acquiring lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] No waiting events found dispatching network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:07 user nova-compute[72620]: WARNING nova.compute.manager [req-c6996ed5-5174-413e-93a5-155b4b551ab3 req-2913abfb-cd8c-4255-9547-a30371c902cf service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received unexpected event network-vif-plugged-e4e3a9d6-32af-45ee-b55f-b97c2070c456 for instance with vm_state active and task_state deleting.
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:07 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Took 1.44 seconds to deallocate network for instance.
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7d83771-2683-489d-a766-b9f8b69610fc req-2684b0f7-2fb2-4613-954d-6aed42e8806a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Received event network-vif-deleted-e4e3a9d6-32af-45ee-b55f-b97c2070c456 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:07 user nova-compute[72620]: INFO nova.compute.manager [req-b7d83771-2683-489d-a766-b9f8b69610fc req-2684b0f7-2fb2-4613-954d-6aed42e8806a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Neutron deleted interface e4e3a9d6-32af-45ee-b55f-b97c2070c456; detaching it from the instance and deleting it from the info cache
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.network.neutron [req-b7d83771-2683-489d-a766-b9f8b69610fc req-2684b0f7-2fb2-4613-954d-6aed42e8806a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7d83771-2683-489d-a766-b9f8b69610fc req-2684b0f7-2fb2-4613-954d-6aed42e8806a service nova] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Detach interface failed, port_id=e4e3a9d6-32af-45ee-b55f-b97c2070c456, reason: Instance efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:47:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:08 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Deleted allocations for instance efcb41f7-3b96-4afc-b6f3-b4a21fd6b753
Aug 09 20:47:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-34c37b2c-e4b4-4988-a115-7b0497ecd5ac tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "efcb41f7-3b96-4afc-b6f3-b4a21fd6b753" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.469s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:20 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614025.6604385, efcb41f7-3b96-4afc-b6f3-b4a21fd6b753 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:47:20 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] VM Stopped (Lifecycle Event)
Aug 09 20:47:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9f8c7749-9550-4ce7-acd6-5ab4f0a6edd0 None None] [instance: efcb41f7-3b96-4afc-b6f3-b4a21fd6b753] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:47:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:29 user nova-compute[72620]: INFO nova.compute.manager [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Unrescuing
Aug 09 20:47:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'flavor' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:31 user nova-compute[72620]: WARNING nova.compute.manager [req-7d395811-6ec4-4499-ab18-a8bf977c39ba req-4a333c4e-1203-467a-a4c9-e799dc6247ba service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance destroyed successfully.
Aug 09 20:47:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:33 user nova-compute[72620]: WARNING nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:33 user nova-compute[72620]: WARNING nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-changed-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing instance network info cache due to event network-changed-6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updated VIF entry in instance network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-changed-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing instance network info cache due to event network-changed-6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Refreshing network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updated VIF entry in instance network info cache for port 6510a428-7366-4a0b-8e14-0518304756c7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:34 user nova-compute[72620]: WARNING nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:34 user nova-compute[72620]: WARNING nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:34 user nova-compute[72620]: WARNING nova.compute.manager [req-bfa89fb9-573f-453f-948d-ad005ae6eb6f req-e9ade702-b535-4f2c-b5d8-75248297fcdb service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614055.402016, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:47:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Resumed (Lifecycle Event)
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-76c2e36f-cb5d-46d4-958c-102405cc1dcc tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:35 user nova-compute[72620]: WARNING nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:35 user nova-compute[72620]: WARNING nova.compute.manager [req-755cac21-ffd8-4969-be8b-75e39e32051e req-309c7278-0962-4245-a6a0-775a943e76be service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:47:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614055.406514, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:47:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Started (Lifecycle Event)
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:47:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Port dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd binding to destination host user is already ACTIVE {{(pid=72620) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Creating tmpfile /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/tmp0q_w1wzk to verify with other compute node that the instance is on the same shared storage. {{(pid=72620) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:39 user nova-compute[72620]: WARNING nova.compute.manager [req-948d5d8f-9dd7-431a-afae-7d3d6b3ec152 req-e7b31b12-21c4-4386-b524-bc2fe8a792cc service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state resized and task_state resize_reverting.
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance destroyed successfully.
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'resources' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdabb0b-cb, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:47:40 user nova-compute[72620]: INFO os_vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:47:40 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1282e269-6fd3-4481-b332-51fff51a82b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b38fc0d-091b-4599-b431-1f2f67461c33]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:40 user nova-compute[72620]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:47:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:40 user nova-compute[72620]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:47:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305c93f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9008f8-876c-4f5c-a6c3-0c40a8d1d832]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74164449-3f8e-4ddb-a468-ca9751d11040]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297097f-d0b0-4b5d-9535-7e272cfd63af]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41c491d-e6cd-4bf3-afb6-1f39c5e4f24a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f185c9-39fc-43a0-88c8-b656d595fd63]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a463a08d-4483-43e2-b036-69c4f30aebd3]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:47:40 user nova-compute[72620]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:47:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be1cad-013e-45b1-ba80-07b6ccdd1c5e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== disconnect_volume: return (330ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:47:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:47:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:42 user nova-compute[72620]: WARNING nova.compute.manager [req-c110ba04-8c13-472d-8da9-77f3a376ffd3 req-9ada88d3-d266-421b-b67c-fff6918c38b6 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state resized and task_state resize_reverting.
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'migration_context' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:47:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.557s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:43 user nova-compute[72620]: INFO nova.compute.manager [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Swapping old allocation on dict_keys(['bf3cd726-0758-4dff-9e6c-ef2d0988f3d1']) held by migration a8790657-10e9-4dfd-9c2d-bf10a1503434 for instance
Aug 09 20:47:43 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Overwriting current allocation {'allocations': {'bf3cd726-0758-4dff-9e6c-ef2d0988f3d1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 20}}, 'project_id': '98aa07c3778141cfbf35d9fd26289d02', 'user_id': '5346961c66f84f0cbc929b2de7d72485', 'consumer_generation': 1} on consumer e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 09 20:47:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquired lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:43 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Releasing lock "refresh_cache-e96165b1-5eca-4530-821e-b00b66710ca1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.utils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec697c0-63e2-4780-abae-19f8bbd82116]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1627c98-8bd7-421c-b12a-a8e5b98edadd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d961d-3f76-445d-96dd-e6605a5c6dbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b85370-3035-492a-8d5b-f8fbdcba830d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:47:44 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:47:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[429714fe-e4ef-477b-b340-cf595b91cbd7]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:47:44 user nova-compute[72620]: DEBUG os_brick.utils [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:47:45 user nova-compute[72620]: INFO nova.compute.claims [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Claim successful on node user
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:47:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:47:46 user nova-compute[72620]: INFO nova.virt.block_device [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Booting with blank volume at /dev/vda
Aug 09 20:47:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:46 user nova-compute[72620]: DEBUG nova.policy [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f794b9e72d4443e86ada7b257af84a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f5de1122514369a2b3f71ae1146194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:47:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Successfully created port: c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Successfully updated port: c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-changed-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Refreshing instance network info cache due to event network-changed-c5e5d2ea-0d2d-4243-bd26-0777a846d59b. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [{"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance network_info: |[{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Refreshing network info cache for port c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.utils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0466dfa-c129-4647-beb8-f36f0f592744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6800fe-2b75-4872-9bb8-851adcd8dfdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e5095-af55-4dbb-a122-9581c4452e67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6133bf60-1b49-4c04-96e7-5f07698a0b53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:47:52 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ca8cc-666f-44d2-ac12-40a807574fbd]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG os_brick.utils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating existing volume attachment record: 65d48898-54ab-4267-ae93-115ce53e50eb {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updated VIF entry in instance network info cache for port c5e5d2ea-0d2d-4243-bd26-0777a846d59b. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:47:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f5ee854c-8180-402f-b793-ebccd1572df8 req-3dd65c4e-ab88-48f8-93ea-1b1feb2f8e93 service nova] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Starting finish_revert_migration {{(pid=72620) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start _get_guest_xml network_info=[{"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e96165b1-5eca-4530-821e-b00b66710ca1', 'attached_at': '2023-08-09T20:47:55.000000', 'detached_at': '', 'volume_id': '29c9f7db-f4ad-42b5-9765-0504d3952cdf', 'serial': '29c9f7db-f4ad-42b5-9765-0504d3952cdf'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'dff0f197-d9dd-4538-97d9-bbf364abe63f', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:47:54 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:47:54 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'vcpu_model' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:47:54 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:47:54 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:47:54 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d19ae-a8a0-4d80-92b1-5a32e341c946]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:47:54 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04204b64-147f-4b70-b9cf-c9d85f567676]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf] added
Aug 09 20:47:54 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a456d45-b2b2-4c79-b168-93f8f94245bb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112627d-9bcb-477e-a9a6-73964e8fd060]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPCQFNVG" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1ef291-b319-45d8-b3e8-c6770d46cdba]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPCQFNVG'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba96e69-84d2-4ee0-a9af-3ab9f6ebb915]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[26851e3c-4f77-434c-82af-52f78309fa1e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:55 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:55 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[520378fe-2e6c-4ecf-b8bb-2b696b0a1324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:47:55 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:47:55 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae20b3-29bd-4f42-b392-e128d20d12c7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f847da2-098b-4a86-b177-a698015abb1c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:55 user nova-compute[72620]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:47:55 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:47:55 user nova-compute[72620]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:47:55 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997302b-eb8f-40f0-862e-5202425976f1]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614060.4785416, e96165b1-5eca-4530-821e-b00b66710ca1 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:47:55 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Stopped (Lifecycle Event)
Aug 09 20:47:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-43529bf0-b043-452e-b842-8d788460f13b None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235363030626631', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:47:56 user nova-compute[72620]:   <uuid>e96165b1-5eca-4530-821e-b00b66710ca1</uuid>
Aug 09 20:47:56 user nova-compute[72620]:   <name>instance-00000004</name>
Aug 09 20:47:56 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:47:56 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:47:56 user nova-compute[72620]:   <metadata>
Aug 09 20:47:56 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:47:56 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherB-server-1923729587</nova:name>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:47:54</nova:creationTime>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:47:56 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:47:56 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:owner>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:user uuid="5346961c66f84f0cbc929b2de7d72485">tempest-ServerActionsTestOtherB-257906244-project-member</nova:user>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:project uuid="98aa07c3778141cfbf35d9fd26289d02">tempest-ServerActionsTestOtherB-257906244</nova:project>
Aug 09 20:47:56 user nova-compute[72620]:       </nova:owner>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:47:56 user nova-compute[72620]:       <nova:ports>
Aug 09 20:47:56 user nova-compute[72620]:         <nova:port uuid="dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd">
Aug 09 20:47:56 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 20:47:56 user nova-compute[72620]:         </nova:port>
Aug 09 20:47:56 user nova-compute[72620]:       </nova:ports>
Aug 09 20:47:56 user nova-compute[72620]:     </nova:instance>
Aug 09 20:47:56 user nova-compute[72620]:   </metadata>
Aug 09 20:47:56 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:47:56 user nova-compute[72620]:     <system>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="serial">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="uuid">e96165b1-5eca-4530-821e-b00b66710ca1</entry>
Aug 09 20:47:56 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:47:56 user nova-compute[72620]:     </system>
Aug 09 20:47:56 user nova-compute[72620]:   </sysinfo>
Aug 09 20:47:56 user nova-compute[72620]:   <os>
Aug 09 20:47:56 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:47:56 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:47:56 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:47:56 user nova-compute[72620]:   </os>
Aug 09 20:47:56 user nova-compute[72620]:   <features>
Aug 09 20:47:56 user nova-compute[72620]:     <acpi/>
Aug 09 20:47:56 user nova-compute[72620]:     <apic/>
Aug 09 20:47:56 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:47:56 user nova-compute[72620]:   </features>
Aug 09 20:47:56 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:47:56 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:47:56 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:47:56 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:47:56 user nova-compute[72620]:   </clock>
Aug 09 20:47:56 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:47:56 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:47:56 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:47:56 user nova-compute[72620]:   </cpu>
Aug 09 20:47:56 user nova-compute[72620]:   <devices>
Aug 09 20:47:56 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:47:56 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:47:56 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk"/>
Aug 09 20:47:56 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:47:56 user nova-compute[72620]:     </disk>
Aug 09 20:47:56 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:47:56 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:47:56 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:47:56 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:47:56 user nova-compute[72620]:       <serial>29c9f7db-f4ad-42b5-9765-0504d3952cdf</serial>
Aug 09 20:47:56 user nova-compute[72620]:     </disk>
Aug 09 20:47:56 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:47:56 user nova-compute[72620]:       <mac address="fa:16:3e:d5:05:b1"/>
Aug 09 20:47:56 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:47:56 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:47:56 user nova-compute[72620]:       <target dev="tapdfdabb0b-cb"/>
Aug 09 20:47:56 user nova-compute[72620]:     </interface>
Aug 09 20:47:56 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:47:56 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/console.log" append="off"/>
Aug 09 20:47:56 user nova-compute[72620]:     </serial>
Aug 09 20:47:56 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:47:56 user nova-compute[72620]:     <video>
Aug 09 20:47:56 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:47:56 user nova-compute[72620]:     </video>
Aug 09 20:47:56 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:47:56 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:47:56 user nova-compute[72620]:     </rng>
Aug 09 20:47:56 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:47:56 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:47:56 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:47:56 user nova-compute[72620]:     </memballoon>
Aug 09 20:47:56 user nova-compute[72620]:   </devices>
Aug 09 20:47:56 user nova-compute[72620]: </domain>
Aug 09 20:47:56 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:47:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG os_vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdabb0b-cb, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfdabb0b-cb, col_values=(('external_ids', {'iface-id': 'dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:05:b1', 'vm-uuid': 'e96165b1-5eca-4530-821e-b00b66710ca1'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:56 user nova-compute[72620]: INFO os_vif [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:47:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:57 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:47:58 user nova-compute[72620]: WARNING nova.compute.manager [req-b0fdd471-1214-46d2-a3c8-75d8530748d9 req-2d93c34b-e6ff-4e0c-9cb3-3d87f458b788 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state resized and task_state resize_reverting.
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:47:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614080.397574, e96165b1-5eca-4530-821e-b00b66710ca1 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Resumed (Lifecycle Event)
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:00 user nova-compute[72620]: WARNING nova.compute.manager [req-d305eedf-ae82-417c-9b92-8c44b0e88894 req-762e9424-3f5c-4ee6-b4e5-7a20051d42cf service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state resized and task_state resize_reverting.
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance running successfully.
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] finish_revert_migration finished successfully. {{(pid=72620) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614080.4007175, e96165b1-5eca-4530-821e-b00b66710ca1 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Started (Lifecycle Event)
Aug 09 20:48:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 09 20:48:00 user nova-compute[72620]: INFO nova.compute.manager [None req-2f2104f7-8315-4384-8d5a-51be1ed0ba99 tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance to original state: 'active'
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:01 user nova-compute[72620]: INFO nova.compute.manager [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Unrescuing
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:48:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'flavor' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:02 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:02 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:02 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.4154052734375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 0549bece-50e4-414b-945c-1b7338d23a8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:03 user nova-compute[72620]: WARNING nova.compute.manager [req-5d8315bb-e16c-456e-bac9-2777395e43a4 req-817688a9-5f73-4810-961a-1b8b8e1762b9 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:48:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:48:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance destroyed successfully.
Aug 09 20:48:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:04 user nova-compute[72620]: INFO nova.compute.manager [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Detaching volume 6af5d637-9584-42f7-88e8-e0419de03c67
Aug 09 20:48:04 user nova-compute[72620]: INFO nova.virt.block_device [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Attempting to driver detach volume 6af5d637-9584-42f7-88e8-e0419de03c67 from mountpoint /dev/vdb
Aug 09 20:48:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Attempting to detach device vdb from instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:48:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:48:04 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:48:04 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 20:48:04 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:48:04 user nova-compute[72620]:   <serial>6af5d637-9584-42f7-88e8-e0419de03c67</serial>
Aug 09 20:48:04 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:48:04 user nova-compute[72620]: </disk>
Aug 09 20:48:04 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:48:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Successfully detached device vdb from instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 from the persistent domain config.
Aug 09 20:48:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:48:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:48:04 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:48:04 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 20:48:04 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:48:04 user nova-compute[72620]:   <serial>6af5d637-9584-42f7-88e8-e0419de03c67</serial>
Aug 09 20:48:04 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:48:04 user nova-compute[72620]: </disk>
Aug 09 20:48:04 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614085.3108933, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:48:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Successfully detached device vdb from instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 from the live domain config.
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laZOkLzi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b0d8b-a8c1-48e1-8542-83b8d4ae5532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcd2d47-a4a1-4334-b0bd-5718af82c69a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:48:05 user nova-compute[72620]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 (non-flash)
Aug 09 20:48:05 user nova-compute[72620]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305030a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20377e8-7fb0-4ab9-9050-015f69075a64]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fc793-6335-42b0-8569-aa2f80978b0f]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:05 user nova-compute[72620]: WARNING nova.compute.manager [req-f8863f16-0a9d-4695-a46a-10aed620234d req-a3fe0df2-210d-45bd-b634-bdba2e3b3b79 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ddec7-0901-4bec-8648-7a3aa62bbcc8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d499f-a48e-49a3-a6ff-7d4cd855bef1]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a65a2-5c5b-42d6-b374-1f5d37d40f98]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8aa5e6-ada1-4acd-a1bf-6ed67c408996]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260]
Aug 09 20:48:05 user nova-compute[72620]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67, portal: 172.16.0.220,3260] successful.
Aug 09 20:48:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6af5d637-9584-42f7-88e8-e0419de03c67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca44367-4833-4219-8b28-40c89ff6bbe0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] <== disconnect_volume: return (372ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:05 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:48:05 user nova-compute[72620]: INFO nova.compute.claims [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Claim successful on node user
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:06 user nova-compute[72620]: INFO nova.compute.manager [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Terminating instance
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:48:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-unplugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] No waiting events found dispatching network-vif-unplugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bbc1e1f-9f91-4509-a8b1-eaa4c683617e req-dde7729c-c724-446f-943e-8ecfb7b00005 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-unplugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.policy [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93ec7531ffb048959bb3d9e47eba8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe04d8fa9624440a7e46af39c41a498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'flavor' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:48:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Creating image(s)
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e8ee3720-9a22-416c-ad25-cf0305fa2d20 tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.319s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:07 user nova-compute[72620]: WARNING nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:07 user nova-compute[72620]: WARNING nova.compute.manager [req-8c645689-f1ff-4223-9ab5-9663cce16500 req-b17f7c28-fd14-4ef5-b117-3bc1e2b02b91 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:48:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Instance destroyed successfully.
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lazy-loading 'resources' on Instance uuid 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-377301624',display_name='tempest-VolumesAdminNegativeTest-server-377301624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-377301624',id=8,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEukBdZuBtrocSvFPKwMW5Z7MKopI+xCHhqSCBdFFhnvm5z3+koK/v8IIP7yDB7aSbWpYti51avv6kPsK/sYi0FI3Np01GkOJO6RQFd2zIc4gF6+QtQpVb+EEjXEU9jHHA==',key_name='tempest-keypair-2137774886',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8904bc2939444f9a9270c2b48043bc6e',ramdisk_id='',reservation_id='r-kyftn20a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1213195220',owner_user_name='tempest-VolumesAdminNegativeTest-1213195220-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97d6d0ff7eee41559a923dfafce80855',uuid=1599e5b0-6de6-4e88-a67f-c9b4e118ebc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converting VIF {"id": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "address": "fa:16:3e:7d:f5:2b", "network": {"id": "697d6d2f-ce29-433c-83c4-a02cf8c21bc6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-369541382-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8904bc2939444f9a9270c2b48043bc6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e5c3058-1e", "ovs_interfaceid": "8e5c3058-1ed5-46a2-ac9c-08b6e378f85d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG os_vif [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e5c3058-1e, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:07 user nova-compute[72620]: INFO os_vif [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f5:2b,bridge_name='br-int',has_traffic_filtering=True,id=8e5c3058-1ed5-46a2-ac9c-08b6e378f85d,network=Network(697d6d2f-ce29-433c-83c4-a02cf8c21bc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e5c3058-1e')
Aug 09 20:48:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Deleting instance files /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1_del
Aug 09 20:48:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Deletion of /opt/stack/data/nova/instances/1599e5b0-6de6-4e88-a67f-c9b4e118ebc1_del complete
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.part --force-share --output=json" returned: 0 in 0.231s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.virt.images [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] a99b13de-9dd8-4a36-b85e-3842cbb50df7 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.part /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Successfully created port: 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:48:08 user nova-compute[72620]: INFO nova.compute.manager [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Took 1.84 seconds to destroy the instance on the hypervisor.
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.part /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.converted" returned: 0 in 0.270s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.454s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] Acquiring lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] No waiting events found dispatching network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:08 user nova-compute[72620]: WARNING nova.compute.manager [req-a4913827-c5bb-4b6e-9774-e1e0f8dbc5bc req-27b1a6e4-35f8-4b81-919a-18262de37964 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received unexpected event network-vif-plugged-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d for instance with vm_state active and task_state deleting.
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json" returned: 0 in 0.253s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97,backing_fmt=raw /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Successfully updated port: 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97,backing_fmt=raw /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk 1073741824" returned: 0 in 0.277s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "6dce56013317c7806e3d9924bf23fe7c0fb3ac97" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.535s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for df3a42a3-a50e-48d0-8962-2f77d4dea766 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614089.1109474, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:09 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Resumed (Lifecycle Event)
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1d037445-6ca0-41ac-837f-31bb8caf8f5e tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:09 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Took 1.15 seconds to deallocate network for instance.
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json" returned: 0 in 0.181s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614089.1122391, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:09 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Started (Lifecycle Event)
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing instance network info cache due to event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.549s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Cannot resize image /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'migration_context' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Ensure instance console log exists: /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance network_info: |[{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start _get_guest_xml network_info=[{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:48:02Z,direct_url=<?>,disk_format='qcow2',id=a99b13de-9dd8-4a36-b85e-3842cbb50df7,min_disk=0,min_ram=0,name='tempest-scenario-img--193722482',owner='4fe04d8fa9624440a7e46af39c41a498',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:48:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'a99b13de-9dd8-4a36-b85e-3842cbb50df7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:48:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:48:02Z,direct_url=<?>,disk_format='qcow2',id=a99b13de-9dd8-4a36-b85e-3842cbb50df7,min_disk=0,min_ram=0,name='tempest-scenario-img--193722482',owner='4fe04d8fa9624440a7e46af39c41a498',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:48:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:07Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'pci_devices' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:48:10 user nova-compute[72620]:   <uuid>f549b053-68a4-415c-890b-85aff113aa9f</uuid>
Aug 09 20:48:10 user nova-compute[72620]:   <name>instance-00000012</name>
Aug 09 20:48:10 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:48:10 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:48:10 user nova-compute[72620]:   <metadata>
Aug 09 20:48:10 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:48:10 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:name>tempest-TestMinimumBasicScenario-server-808070253</nova:name>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:48:10</nova:creationTime>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:48:10 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:48:10 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:owner>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:user uuid="93ec7531ffb048959bb3d9e47eba8485">tempest-TestMinimumBasicScenario-931784319-project-member</nova:user>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:project uuid="4fe04d8fa9624440a7e46af39c41a498">tempest-TestMinimumBasicScenario-931784319</nova:project>
Aug 09 20:48:10 user nova-compute[72620]:       </nova:owner>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:root type="image" uuid="a99b13de-9dd8-4a36-b85e-3842cbb50df7"/>
Aug 09 20:48:10 user nova-compute[72620]:       <nova:ports>
Aug 09 20:48:10 user nova-compute[72620]:         <nova:port uuid="1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f">
Aug 09 20:48:10 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:48:10 user nova-compute[72620]:         </nova:port>
Aug 09 20:48:10 user nova-compute[72620]:       </nova:ports>
Aug 09 20:48:10 user nova-compute[72620]:     </nova:instance>
Aug 09 20:48:10 user nova-compute[72620]:   </metadata>
Aug 09 20:48:10 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:48:10 user nova-compute[72620]:     <system>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="serial">f549b053-68a4-415c-890b-85aff113aa9f</entry>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="uuid">f549b053-68a4-415c-890b-85aff113aa9f</entry>
Aug 09 20:48:10 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:48:10 user nova-compute[72620]:     </system>
Aug 09 20:48:10 user nova-compute[72620]:   </sysinfo>
Aug 09 20:48:10 user nova-compute[72620]:   <os>
Aug 09 20:48:10 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:48:10 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:48:10 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:48:10 user nova-compute[72620]:   </os>
Aug 09 20:48:10 user nova-compute[72620]:   <features>
Aug 09 20:48:10 user nova-compute[72620]:     <acpi/>
Aug 09 20:48:10 user nova-compute[72620]:     <apic/>
Aug 09 20:48:10 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:48:10 user nova-compute[72620]:   </features>
Aug 09 20:48:10 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:48:10 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:48:10 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:48:10 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:48:10 user nova-compute[72620]:   </clock>
Aug 09 20:48:10 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:48:10 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:48:10 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:48:10 user nova-compute[72620]:   </cpu>
Aug 09 20:48:10 user nova-compute[72620]:   <devices>
Aug 09 20:48:10 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:48:10 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:48:10 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk"/>
Aug 09 20:48:10 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:48:10 user nova-compute[72620]:     </disk>
Aug 09 20:48:10 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:48:10 user nova-compute[72620]:       <mac address="fa:16:3e:22:d0:38"/>
Aug 09 20:48:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:10 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:48:10 user nova-compute[72620]:       <target dev="tap1a07b8e0-cf"/>
Aug 09 20:48:10 user nova-compute[72620]:     </interface>
Aug 09 20:48:10 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:48:10 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/console.log" append="off"/>
Aug 09 20:48:10 user nova-compute[72620]:     </serial>
Aug 09 20:48:10 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:48:10 user nova-compute[72620]:     <video>
Aug 09 20:48:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:10 user nova-compute[72620]:     </video>
Aug 09 20:48:10 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:48:10 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:48:10 user nova-compute[72620]:     </rng>
Aug 09 20:48:10 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:48:10 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:48:10 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:48:10 user nova-compute[72620]:     </memballoon>
Aug 09 20:48:10 user nova-compute[72620]:   </devices>
Aug 09 20:48:10 user nova-compute[72620]: </domain>
Aug 09 20:48:10 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:07Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG os_vif [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a07b8e0-cf, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a07b8e0-cf, col_values=(('external_ids', {'iface-id': '1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d0:38', 'vm-uuid': 'f549b053-68a4-415c-890b-85aff113aa9f'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:10 user nova-compute[72620]: INFO os_vif [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf')
Aug 09 20:48:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.958s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:10 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Deleted allocations for instance 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No VIF found with MAC fa:16:3e:22:d0:38, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-873d0232-6d90-4c09-8583-08599eeecd3b tempest-VolumesAdminNegativeTest-1213195220 tempest-VolumesAdminNegativeTest-1213195220-project-member] Lock "1599e5b0-6de6-4e88-a67f-c9b4e118ebc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.258s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updated VIF entry in instance network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cf2c7d7d-fe1f-4f8e-b7c9-b8c2f6583044 req-1f1619c8-d970-4c43-aced-f77d71ed52cd service nova] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-ce5e1ed9-3d4a-48e0-a747-ced6cbeafb3b req-e1bdac0c-daa2-4485-a925-44753e680a66 service nova] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Received event network-vif-deleted-8e5c3058-1ed5-46a2-ac9c-08b6e378f85d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:12 user nova-compute[72620]: WARNING nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state building and task_state spawning.
Aug 09 20:48:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:12 user nova-compute[72620]: WARNING nova.compute.manager [req-59373134-5d36-4147-8669-b4a7609f9809 req-78e7d8cb-82d8-4aaf-9a31-c02745c55dc1 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state building and task_state spawning.
Aug 09 20:48:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614094.3390896, f549b053-68a4-415c-890b-85aff113aa9f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] VM Resumed (Lifecycle Event)
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance spawned successfully.
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614094.340217, f549b053-68a4-415c-890b-85aff113aa9f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] VM Started (Lifecycle Event)
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Took 7.57 seconds to spawn the instance on the hypervisor.
Aug 09 20:48:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:14 user nova-compute[72620]: INFO nova.compute.manager [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Took 8.72 seconds to build instance.
Aug 09 20:48:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2b291952-96ba-48c5-b83c-842c83cacbf8 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.887s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:48:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Creating image(s)
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Ensure instance console log exists: /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start _get_guest_xml network_info=[{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e3f8155-89ec-4ba8-bb1d-cd5d656870b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fea6a825-2021-4061-905b-a5a704d67ada', 'serial': 'fea6a825-2021-4061-905b-a5a704d67ada'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '65d48898-54ab-4267-ae93-115ce53e50eb', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:15 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:15 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:15 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c4c11-3e11-41aa-8c2b-a157099c55fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:48:15 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc911aed-7bb5-4823-bf67-09661003900a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada] added
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248ac90-45e1-4c37-88a4-5847cba33b6e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c066e4a-4f64-4b27-bee4-2c9f2b9cdf7c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQEZSXUk {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQEZSXUk" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[037cd865-f7a9-41ee-82f6-26f56bc36ded]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQEZSXUk'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6db1ac-cfa6-4b25-86cc-a7ade2445fea]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e72ae5f-ec5f-4b4d-8cf0-604cf8e0d1e3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aef430c-8290-400e-b20e-d9304359614d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260]
Aug 09 20:48:15 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260] successful.
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab4e93b-5656-4d52-8491-3124179e2f00]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad2312b-d662-4b65-bcef-1925b2b00104]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:15 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:15 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae24fb00-13a2-46bc-baea-9b09fc5f9b5e]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:48:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26434623364373061', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434623364373061', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2062598968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2062598968',id=17,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-2vy0pz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:47:47Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=1e3f8155-89ec-4ba8-bb1d-cd5d656870b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:48:16 user nova-compute[72620]:   <uuid>1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</uuid>
Aug 09 20:48:16 user nova-compute[72620]:   <name>instance-00000011</name>
Aug 09 20:48:16 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:48:16 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:48:16 user nova-compute[72620]:   <metadata>
Aug 09 20:48:16 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:48:16 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2062598968</nova:name>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:48:15</nova:creationTime>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:48:16 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:48:16 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:owner>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:48:16 user nova-compute[72620]:       </nova:owner>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:48:16 user nova-compute[72620]:       <nova:ports>
Aug 09 20:48:16 user nova-compute[72620]:         <nova:port uuid="c5e5d2ea-0d2d-4243-bd26-0777a846d59b">
Aug 09 20:48:16 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 20:48:16 user nova-compute[72620]:         </nova:port>
Aug 09 20:48:16 user nova-compute[72620]:       </nova:ports>
Aug 09 20:48:16 user nova-compute[72620]:     </nova:instance>
Aug 09 20:48:16 user nova-compute[72620]:   </metadata>
Aug 09 20:48:16 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:48:16 user nova-compute[72620]:     <system>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="serial">1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</entry>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="uuid">1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</entry>
Aug 09 20:48:16 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:48:16 user nova-compute[72620]:     </system>
Aug 09 20:48:16 user nova-compute[72620]:   </sysinfo>
Aug 09 20:48:16 user nova-compute[72620]:   <os>
Aug 09 20:48:16 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:48:16 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:48:16 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:48:16 user nova-compute[72620]:   </os>
Aug 09 20:48:16 user nova-compute[72620]:   <features>
Aug 09 20:48:16 user nova-compute[72620]:     <acpi/>
Aug 09 20:48:16 user nova-compute[72620]:     <apic/>
Aug 09 20:48:16 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:48:16 user nova-compute[72620]:   </features>
Aug 09 20:48:16 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:48:16 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:48:16 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:48:16 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:48:16 user nova-compute[72620]:   </clock>
Aug 09 20:48:16 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:48:16 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:48:16 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:48:16 user nova-compute[72620]:   </cpu>
Aug 09 20:48:16 user nova-compute[72620]:   <devices>
Aug 09 20:48:16 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:48:16 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:48:16 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 20:48:16 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:48:16 user nova-compute[72620]:       <serial>fea6a825-2021-4061-905b-a5a704d67ada</serial>
Aug 09 20:48:16 user nova-compute[72620]:     </disk>
Aug 09 20:48:16 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:48:16 user nova-compute[72620]:       <mac address="fa:16:3e:ae:9c:42"/>
Aug 09 20:48:16 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:16 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:48:16 user nova-compute[72620]:       <target dev="tapc5e5d2ea-0d"/>
Aug 09 20:48:16 user nova-compute[72620]:     </interface>
Aug 09 20:48:16 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:48:16 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/console.log" append="off"/>
Aug 09 20:48:16 user nova-compute[72620]:     </serial>
Aug 09 20:48:16 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:48:16 user nova-compute[72620]:     <video>
Aug 09 20:48:16 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:16 user nova-compute[72620]:     </video>
Aug 09 20:48:16 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:48:16 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:48:16 user nova-compute[72620]:     </rng>
Aug 09 20:48:16 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:48:16 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:48:16 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:48:16 user nova-compute[72620]:     </memballoon>
Aug 09 20:48:16 user nova-compute[72620]:   </devices>
Aug 09 20:48:16 user nova-compute[72620]: </domain>
Aug 09 20:48:16 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2062598968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2062598968',id=17,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-2vy0pz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:47:47Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=1e3f8155-89ec-4ba8-bb1d-cd5d656870b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG os_vif [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e5d2ea-0d, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5e5d2ea-0d, col_values=(('external_ids', {'iface-id': 'c5e5d2ea-0d2d-4243-bd26-0777a846d59b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:9c:42', 'vm-uuid': '1e3f8155-89ec-4ba8-bb1d-cd5d656870b3'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:16 user nova-compute[72620]: INFO os_vif [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d')
Aug 09 20:48:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:ae:9c:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:48:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:19 user nova-compute[72620]: WARNING nova.compute.manager [req-ce41a4aa-b52b-4ef5-8336-a4d68bf3f56a req-e2dc9180-8bf9-4445-9406-d8096bcaba13 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state building and task_state spawning.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614101.0388463, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Resumed (Lifecycle Event)
Aug 09 20:48:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance spawned successfully.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:21 user nova-compute[72620]: WARNING nova.compute.manager [req-7f916521-5416-483c-aba4-2147fd528c4a req-ad298d73-475a-4f9d-99ea-6e9fb696b850 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state building and task_state spawning.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614101.0436406, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Started (Lifecycle Event)
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:21 user nova-compute[72620]: INFO nova.compute.manager [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Took 35.37 seconds to build instance.
Aug 09 20:48:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbc2c3bd-e131-444f-aef2-4420a8425304 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.562s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:22 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614087.1334965, 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:22 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] VM Stopped (Lifecycle Event)
Aug 09 20:48:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1c473203-cf34-4e39-857e-1166df84f509 None None] [instance: 1599e5b0-6de6-4e88-a67f-c9b4e118ebc1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-changed-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Refreshing instance network info cache due to event network-changed-33d0fedc-a465-457a-959d-c054e1e8a0e4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Refreshing network info cache for port 33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updated VIF entry in instance network info cache for port 33d0fedc-a465-457a-959d-c054e1e8a0e4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-406d022d-fc4a-4b84-aff4-41185d480b4e req-a20f9880-6018-41a5-b4e3-a79932a2f366 service nova] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:30 user nova-compute[72620]: INFO nova.compute.manager [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Attaching volume 224a834a-cc1c-4891-ad45-87a17743e10f to /dev/vdb
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.utils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7239f4-1370-4a65-b8a9-98292f7a747f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[426f03bc-c424-4dae-9a66-459fa10c98f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e97ef-b668-474e-a313-24707438bf40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afab8f-6f88-4d87-a04d-e77de27ba2a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:30 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:48:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5afaf6-3a0d-4561-a3b0-8ccc24bcd9fb]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG os_brick.utils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:30 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating existing volume attachment record: be614e86-32ce-47eb-b4f9-00c3c30ad2a2 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:48:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-changed-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Refreshing instance network info cache due to event network-changed-6e0ba9d7-393f-4ce5-850e-ce72c67ed053. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] Acquiring lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] Acquired lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Refreshing network info cache for port 6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.objects.instance [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'flavor' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:36 user nova-compute[72620]: INFO nova.compute.manager [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attaching volume c3d5c184-a525-4de4-b675-dca99289d110 to /dev/vdb
Aug 09 20:48:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updated VIF entry in instance network info cache for port 6e0ba9d7-393f-4ce5-850e-ce72c67ed053. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating instance_info_cache with network_info: [{"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9ffdfb59-36eb-4d78-8f3c-ab715e04b2bc req-f2a03d0b-0669-44cf-8afb-e6d106c717c9 service nova] Releasing lock "refresh_cache-0549bece-50e4-414b-945c-1b7338d23a8c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG os_brick.utils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa78246d-4418-4602-ba43-a6a2b56fc6e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1609d1-1bac-4c91-a327-f74b8ef9668d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ca6c70-e6cf-409e-80ab-06de6df4c5d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a465f3f3-4cd6-40da-9e54-88f7e838f255]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:37 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:48:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915ceba-c66f-4273-b30d-dc57e07eede2]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG os_brick.utils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:37 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating existing volume attachment record: 390ec6a1-6db3-4553-beab-30b134e3a440 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:48:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:40 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:40 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:40 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c918ef3d-cb4f-4d2a-8e91-1f9cec6ee16f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:48:40 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49d9f93-50af-479b-a37a-6698d70ffcdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f] added
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ee71a-ef62-4ddb-9d53-8b4318929f4f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ad8fc5-bfcc-4eb9-92b6-4931825d5861]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEBfUXxH {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEBfUXxH" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7281377-c86a-4006-96bc-cb77788e9718]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEBfUXxH'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340590a-a06b-4c54-b43e-ffc2bf5a8112]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d337d25-90fe-4c49-b4a3-635732b339f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0864fb7-f186-4719-ae03-dd931688d42e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]
Aug 09 20:48:40 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e91e5-57b7-4160-b208-b5eb843d439b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2ca793-6fde-4081-b345-dede06615280]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:40 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:48:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[43023f47-fa44-4fe0-8d50-699378deea8a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23833363762373034', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833363762373034', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:48:42 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:48:42 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:48:42 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:48:42 user nova-compute[72620]:   <serial>224a834a-cc1c-4891-ad45-87a17743e10f</serial>
Aug 09 20:48:42 user nova-compute[72620]: </disk>
Aug 09 20:48:42 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No VIF found with MAC fa:16:3e:aa:60:d6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:48:42 user nova-compute[72620]: INFO nova.compute.claims [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Claim successful on node user
Aug 09 20:48:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bd602956-df93-4bb2-9c53-91da7043f135 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.252s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:48:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:48:43 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.policy [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99eca3cb88e349c38b46fdd75ad21c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355c9ed1b3bf41c79a2e58158b3469d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:48:43 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Creating image(s)
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "/opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "/opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.165s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72620) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.objects.instance [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk 1073741824" returned: 0 in 0.062s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Cannot resize image /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'migration_context' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Ensure instance console log exists: /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:44 user nova-compute[72620]: WARNING nova.compute.manager [req-4712a578-f88d-49fb-9013-94a197e634ed req-8684ade6-1e32-4b32-9ce2-3eb9cddc7804 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state active and task_state powering-off.
Aug 09 20:48:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance destroyed successfully.
Aug 09 20:48:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Successfully created port: e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:48:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-03291244-e540-4a9d-86fc-b92ed6988a44 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.956s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Successfully updated port: e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquired lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Releasing lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Instance network_info: |[{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Start _get_guest_xml network_info=[{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:48:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-724924295',display_name='tempest-TestStampPattern-server-724924295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-724924295',id=19,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-1e9c9ymk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:43Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=7b0d54ec-1ee4-498d-adb0-68f98faa4db5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:48:45 user nova-compute[72620]:   <uuid>7b0d54ec-1ee4-498d-adb0-68f98faa4db5</uuid>
Aug 09 20:48:45 user nova-compute[72620]:   <name>instance-00000013</name>
Aug 09 20:48:45 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:48:45 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:48:45 user nova-compute[72620]:   <metadata>
Aug 09 20:48:45 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:48:45 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:name>tempest-TestStampPattern-server-724924295</nova:name>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:48:45</nova:creationTime>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:48:45 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:48:45 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:owner>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:user uuid="99eca3cb88e349c38b46fdd75ad21c69">tempest-TestStampPattern-1200029945-project-member</nova:user>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:project uuid="355c9ed1b3bf41c79a2e58158b3469d6">tempest-TestStampPattern-1200029945</nova:project>
Aug 09 20:48:45 user nova-compute[72620]:       </nova:owner>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:48:45 user nova-compute[72620]:       <nova:ports>
Aug 09 20:48:45 user nova-compute[72620]:         <nova:port uuid="e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f">
Aug 09 20:48:45 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 20:48:45 user nova-compute[72620]:         </nova:port>
Aug 09 20:48:45 user nova-compute[72620]:       </nova:ports>
Aug 09 20:48:45 user nova-compute[72620]:     </nova:instance>
Aug 09 20:48:45 user nova-compute[72620]:   </metadata>
Aug 09 20:48:45 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:48:45 user nova-compute[72620]:     <system>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="serial">7b0d54ec-1ee4-498d-adb0-68f98faa4db5</entry>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="uuid">7b0d54ec-1ee4-498d-adb0-68f98faa4db5</entry>
Aug 09 20:48:45 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:48:45 user nova-compute[72620]:     </system>
Aug 09 20:48:45 user nova-compute[72620]:   </sysinfo>
Aug 09 20:48:45 user nova-compute[72620]:   <os>
Aug 09 20:48:45 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:48:45 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:48:45 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:48:45 user nova-compute[72620]:   </os>
Aug 09 20:48:45 user nova-compute[72620]:   <features>
Aug 09 20:48:45 user nova-compute[72620]:     <acpi/>
Aug 09 20:48:45 user nova-compute[72620]:     <apic/>
Aug 09 20:48:45 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:48:45 user nova-compute[72620]:   </features>
Aug 09 20:48:45 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:48:45 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:48:45 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:48:45 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:48:45 user nova-compute[72620]:   </clock>
Aug 09 20:48:45 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:48:45 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:48:45 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:48:45 user nova-compute[72620]:   </cpu>
Aug 09 20:48:45 user nova-compute[72620]:   <devices>
Aug 09 20:48:45 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:48:45 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:48:45 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk"/>
Aug 09 20:48:45 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:48:45 user nova-compute[72620]:     </disk>
Aug 09 20:48:45 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:48:45 user nova-compute[72620]:       <mac address="fa:16:3e:e8:13:22"/>
Aug 09 20:48:45 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:45 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:48:45 user nova-compute[72620]:       <target dev="tape8b9c8a3-9b"/>
Aug 09 20:48:45 user nova-compute[72620]:     </interface>
Aug 09 20:48:45 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:48:45 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/console.log" append="off"/>
Aug 09 20:48:45 user nova-compute[72620]:     </serial>
Aug 09 20:48:45 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:48:45 user nova-compute[72620]:     <video>
Aug 09 20:48:45 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:48:45 user nova-compute[72620]:     </video>
Aug 09 20:48:45 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:48:45 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:48:45 user nova-compute[72620]:     </rng>
Aug 09 20:48:45 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:48:45 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:48:45 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:48:45 user nova-compute[72620]:     </memballoon>
Aug 09 20:48:45 user nova-compute[72620]:   </devices>
Aug 09 20:48:45 user nova-compute[72620]: </domain>
Aug 09 20:48:45 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-724924295',display_name='tempest-TestStampPattern-server-724924295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-724924295',id=19,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-1e9c9ymk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:43Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=7b0d54ec-1ee4-498d-adb0-68f98faa4db5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG os_vif [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8b9c8a3-9b, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8b9c8a3-9b, col_values=(('external_ids', {'iface-id': 'e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:13:22', 'vm-uuid': '7b0d54ec-1ee4-498d-adb0-68f98faa4db5'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:48:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:45 user nova-compute[72620]: INFO os_vif [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b')
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No VIF found with MAC fa:16:3e:e8:13:22, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:46 user nova-compute[72620]: WARNING nova.compute.manager [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state None.
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing instance network info cache due to event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Acquiring lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Acquired lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updated VIF entry in instance network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.network.neutron [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff41f5c8-b21b-4286-a7de-9c9faacc0f7a req-6ff16697-2b4c-46d0-94f5-e86c71ab54d3 service nova] Releasing lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:48:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:48:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:48:46 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:48:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aad2c36-7483-4fc8-bfcf-3272fef08b0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:48:47 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b1d32-fade-4fd3-85c1-bb0e46cd021b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110] added
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[86309830-8274-4a83-b750-0ce149b97316]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[006bb8f2-b3bb-492d-83a4-bae2275766da]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoplucGH {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoplucGH" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[083f4f94-6b91-4085-ac99-c1ffef46d811]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoplucGH'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fda97a-ec0a-43db-9daf-a1afe6aeb180]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da9d6e-9588-43e9-992a-cda39368936b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbf4eb5-4e49-447c-82f6-ac41d46fb225]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]
Aug 09 20:48:47 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42e2961-a2ed-4480-b41e-33e70f6a501c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2764394-716b-4105-8483-a9ee6a25567d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:48:47 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:48:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38c07f3-f725-474f-8296-54f19c8c3d19]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] No waiting events found dispatching network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:47 user nova-compute[72620]: WARNING nova.compute.manager [req-b4c6c66f-8662-43b3-8ea2-89c1bba97373 req-4e96172d-a2e0-4145-860e-bc3b5fc4f7ce service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received unexpected event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f for instance with vm_state building and task_state spawning.
Aug 09 20:48:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26337306632366461', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337306632366461', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.objects.instance [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'flavor' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:48:48 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:48:48 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:48:48 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:48:48 user nova-compute[72620]:   <serial>c3d5c184-a525-4de4-b675-dca99289d110</serial>
Aug 09 20:48:48 user nova-compute[72620]: </disk>
Aug 09 20:48:48 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] No VIF found with MAC fa:16:3e:6e:cd:b8, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:48:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-543572ac-5499-4770-9206-c5929f9d6ca0 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.061s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614129.537199, 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] VM Resumed (Lifecycle Event)
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Instance spawned successfully.
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614129.5381172, 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] VM Started (Lifecycle Event)
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] No waiting events found dispatching network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:49 user nova-compute[72620]: WARNING nova.compute.manager [req-9eea33bc-3c55-4350-9bd3-e1d8b1619b23 req-6a52f3db-bc7a-492e-b908-ba19b8dbbc09 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received unexpected event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f for instance with vm_state building and task_state spawning.
Aug 09 20:48:49 user nova-compute[72620]: INFO nova.compute.manager [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Took 7.21 seconds to build instance.
Aug 09 20:48:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f85b1785-861e-488b-b60b-502144512a0f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.350s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9112c8-cf9d-425e-a520-5bd641b439de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00d9e95-f847-477e-bc71-cb3c23ecdd72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ba35f-2d1f-4e6c-9b49-db993dcd51b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebb67e-8f94-4b28-aec0-54e31b73be54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:48:50 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:48:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053d56a-7951-4bf5-9779-e7fa5ee339c2]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:48:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:48:50 user nova-compute[72620]: INFO nova.compute.manager [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Swapping volume c3d5c184-a525-4de4-b675-dca99289d110 for 9882defe-909f-4838-b7d1-b27b7d1f92b8
Aug 09 20:48:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:48:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:55 user nova-compute[72620]: INFO nova.compute.manager [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Terminating instance
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-aa543bd1-4ee6-4aec-b060-72cc2d745cc9 req-acc39923-3adb-41a3-aa2a-8f311cb97d12 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-unplugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:55 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Instance destroyed successfully.
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lazy-loading 'resources' on Instance uuid 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-339600390',display_name='tempest-ServerStableDeviceRescueTest-server-339600390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-339600390',id=5,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDIw6JRw/5sN0nyPc1O6W4xx94shaFnrSQHNikVNokQNzxYCDxhmAEzzPD4xRuf9T/MZp8fxSDwJBAnTIo95pnqZa8PaZvnwuCpgVmloO1+hrXwWRISRIvajls220qrVg==',key_name='tempest-keypair-900329416',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:45:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af525394a7ce4d518ba31b48cc4de994',ramdisk_id='',reservation_id='r-o180qqf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-284578307',owner_user_name='tempest-ServerStableDeviceRescueTest-284578307-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:47:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e03fddb657b24c97a984041ad12da65a',uuid=126f0a38-2bd7-4258-bf85-86bfb9c6d4b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converting VIF {"id": "6510a428-7366-4a0b-8e14-0518304756c7", "address": "fa:16:3e:80:ec:0d", "network": {"id": "cc59e099-b45d-4c76-a680-f1fc5efc42d0", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1412967639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af525394a7ce4d518ba31b48cc4de994", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6510a428-73", "ovs_interfaceid": "6510a428-7366-4a0b-8e14-0518304756c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:48:55 user nova-compute[72620]: DEBUG os_vif [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6510a428-73, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:56 user nova-compute[72620]: INFO os_vif [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=6510a428-7366-4a0b-8e14-0518304756c7,network=Network(cc59e099-b45d-4c76-a680-f1fc5efc42d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6510a428-73')
Aug 09 20:48:56 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Deleting instance files /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0_del
Aug 09 20:48:56 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Deletion of /opt/stack/data/nova/instances/126f0a38-2bd7-4258-bf85-86bfb9c6d4b0_del complete
Aug 09 20:48:56 user nova-compute[72620]: INFO nova.compute.manager [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 20:48:56 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:56 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Took 0.88 seconds to deallocate network for instance.
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ade2749-f46b-4c1b-9c19-d966f09602c0 req-1dbca5e9-2c14-408e-8a7a-535798efe699 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-deleted-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:56 user nova-compute[72620]: INFO nova.compute.manager [req-2ade2749-f46b-4c1b-9c19-d966f09602c0 req-1dbca5e9-2c14-408e-8a7a-535798efe699 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Neutron deleted interface 6510a428-7366-4a0b-8e14-0518304756c7; detaching it from the instance and deleting it from the info cache
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-2ade2749-f46b-4c1b-9c19-d966f09602c0 req-1dbca5e9-2c14-408e-8a7a-535798efe699 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:48:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ade2749-f46b-4c1b-9c19-d966f09602c0 req-1dbca5e9-2c14-408e-8a7a-535798efe699 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Detach interface failed, port_id=6510a428-7366-4a0b-8e14-0518304756c7, reason: Instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:57 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Deleted allocations for instance 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cbe16590-6e38-43be-9dbc-08b8cf2f26da tempest-ServerStableDeviceRescueTest-284578307 tempest-ServerStableDeviceRescueTest-284578307-project-member] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] Acquiring lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] Lock "126f0a38-2bd7-4258-bf85-86bfb9c6d4b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] No waiting events found dispatching network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:48:57 user nova-compute[72620]: WARNING nova.compute.manager [req-7f63b8dc-8b4e-4620-a3cb-105af589dc47 req-7f8ece1b-e12c-4d8d-a10f-5cf969e84442 service nova] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Received unexpected event network-vif-plugged-6510a428-7366-4a0b-8e14-0518304756c7 for instance with vm_state deleted and task_state None.
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:48:57 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614124.4959204, c5872c41-5db7-42aa-9145-108eec912a53 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:48:59 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Stopped (Lifecycle Event)
Aug 09 20:48:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0772da8f-b161-41c8-b482-b2492153a882 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0772da8f-b161-41c8-b482-b2492153a882 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:48:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8', 'serial': '9882defe-909f-4838-b7d1-b27b7d1f92b8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3d5c184-a525-4de4-b675-dca99289d110', 'serial'} {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:00 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:00 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:00 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b4f6a7-b4ae-4461-ab46-2f505b3deb82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:49:00 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f951af-198b-49d1-8224-15a9ab49d74b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8] added
Aug 09 20:49:00 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afdee22-2190-4545-86c4-1cca5b77d9a6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef8bfd-ef0e-4aba-b8c3-6b9c6d69ae97]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAYSrdFE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAYSrdFE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e1853e-d31e-4dfc-b16b-4b8e8a1c73ff]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAYSrdFE'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c104f2-acd0-4cee-b158-50fc3d3e9fc5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba77cb4-434e-43d9-8d8c-3790f99fed07]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:00 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:00 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:00 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:49:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa33ab0-64e2-40ed-b1be-0e0a28e04211]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260]
Aug 09 20:49:01 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260] successful.
Aug 09 20:49:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7662MB free_disk=25.462902069091797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fa840c-d330-45bd-9fb8-dc6e093fc9ae]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[43404861-86c8-4b84-8739-4b1f8ef91851]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:01 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.750s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbcf8d-66cf-44cb-9db3-11da8cfb8a31]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 0549bece-50e4-414b-945c-1b7338d23a8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f549b053-68a4-415c-890b-85aff113aa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.783s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== connect_volume: return (1785ms) {'type': 'block', 'scsi_wwn': '26231663665393730', 'path': '/dev/sdf'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231663665393730', 'path': '/dev/sdf'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:49:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lazy-loading 'flavor' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 65011712 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:03 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 207618048 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 398458880 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 584056832 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 767557632 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:06 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe5828-5f36-48fa-9590-188c1370fed5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f475fcc-9f6a-4658-bf79-e499d6be6fb4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:06 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c50239750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f23eae-a7de-4909-8238-1cee3e2943d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d5c0e-e3c3-49ca-b95e-6a3baece0e7e]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2c4bf2-992e-4275-8b14-7592ef7e2fd3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37df704-eb79-457e-ab86-58ba3d13ccf4]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9521c54-8da6-415f-8e5e-bf23ea87a064]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d1dac-6b64-46a7-b861-b1e3a814ca03]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]
Aug 09 20:49:06 user nova-compute[72620]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.
Aug 09 20:49:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1cc370-1802-4c94-a32b-78cea2d05378]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== disconnect_volume: return (280ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8', 'serial'} {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: removing Cinder connection for volume c3d5c184-a525-4de4-b675-dca99289d110 {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 20:49:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: Updating volume c3d5c184-a525-4de4-b675-dca99289d110 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "OAYSrdFE", "auth_password": "153AdegnLs9UJV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "9882defe-909f-4838-b7d1-b27b7d1f92b8"}, "status": "reserved", "instance": "0549bece-50e4-414b-945c-1b7338d23a8c", "attached_at": "", "detached_at": "", "volume_id": "9882defe-909f-4838-b7d1-b27b7d1f92b8", "serial": "9882defe-909f-4838-b7d1-b27b7d1f92b8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8', 'no_device': None, 'attachment_id': 'b2332088-0fc9-46fb-844a-d218552c5cbb'} {{(pid=72620) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 20:49:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30b2e681-8324-4ec1-ba90-4d92481da252 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.148s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.utils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb2ece6-be06-4965-8b30-6a99eecd2263]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3859c3e-2842-4010-8870-eba2aa1741ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3200b8f9-d688-4847-b241-ca9f074d0220]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d4f8f-82a1-4b80-b05e-2122f142e7b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:49:08 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:49:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d941c0-74b3-4b31-a439-d0cc6c0df426]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:49:08 user nova-compute[72620]: DEBUG os_brick.utils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:08 user nova-compute[72620]: INFO nova.compute.manager [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Swapping volume 9882defe-909f-4838-b7d1-b27b7d1f92b8 for c3d5c184-a525-4de4-b675-dca99289d110
Aug 09 20:49:10 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614135.9726324, 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:49:10 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] VM Stopped (Lifecycle Event)
Aug 09 20:49:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-eec72404-9964-4995-852d-919252ba0ff1 None None] [instance: 126f0a38-2bd7-4258-bf85-86bfb9c6d4b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3d5c184-a525-4de4-b675-dca99289d110', 'serial': 'c3d5c184-a525-4de4-b675-dca99289d110'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8'}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8', 'serial'} {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:17 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad407170-4632-425b-93a5-f27c275daaf2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:49:17 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8b763-5758-4361-a032-61219d35ad64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110] added
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa8532d-4781-4e1c-9602-70d8dcc8fa57]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4882fba-c880-4803-8b9b-d838a5d17421]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoplucGH {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoplucGH" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb94d122-d360-4280-9985-73ffadee665b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoplucGH'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f7249-f142-4a8c-b005-498c55996b2c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca18580f-b1a9-439a-81d3-c463d9ff9857]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81dbe9f-98d6-4974-aebb-a85d354b9bbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]
Aug 09 20:49:17 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec49cd-9bd0-4c32-8154-21452215987e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf7a15-76a1-439d-86d1-9752d466aef1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[023ef84f-09a0-4183-8a7a-64c0dfe29e93]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:49:18 user nova-compute[72620]: INFO nova.compute.claims [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Claim successful on node user
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:49:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.policy [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1546466d62a6410c83fa85f1b0c8b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ded0dc696e4bd6b25a57202b956d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26337306632366461', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337306632366461', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:49:18 user nova-compute[72620]: DEBUG nova.objects.instance [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lazy-loading 'flavor' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:49:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Creating image(s)
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk 1073741824" returned: 0 in 0.059s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 20971520 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Successfully created port: 0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Cannot resize image /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'migration_context' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Ensure instance console log exists: /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 179306496 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 361758720 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Successfully updated port: 0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing instance network info cache due to event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance network_info: |[{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start _get_guest_xml network_info=[{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:49:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1955171695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:49:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_devices' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:49:20 user nova-compute[72620]:   <uuid>bc81ba81-361a-4913-8aab-94e1849f992c</uuid>
Aug 09 20:49:20 user nova-compute[72620]:   <name>instance-00000014</name>
Aug 09 20:49:20 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:49:20 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:49:20 user nova-compute[72620]:   <metadata>
Aug 09 20:49:20 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:49:20 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherA-server-1955171695</nova:name>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:49:20</nova:creationTime>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:49:20 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:49:20 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:owner>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:user uuid="1546466d62a6410c83fa85f1b0c8b934">tempest-ServerActionsTestOtherA-763482691-project-member</nova:user>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:project uuid="80ded0dc696e4bd6b25a57202b956d63">tempest-ServerActionsTestOtherA-763482691</nova:project>
Aug 09 20:49:20 user nova-compute[72620]:       </nova:owner>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:49:20 user nova-compute[72620]:       <nova:ports>
Aug 09 20:49:20 user nova-compute[72620]:         <nova:port uuid="0204bf3f-57ea-46ae-a128-69fb487866ff">
Aug 09 20:49:20 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:49:20 user nova-compute[72620]:         </nova:port>
Aug 09 20:49:20 user nova-compute[72620]:       </nova:ports>
Aug 09 20:49:20 user nova-compute[72620]:     </nova:instance>
Aug 09 20:49:20 user nova-compute[72620]:   </metadata>
Aug 09 20:49:20 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:49:20 user nova-compute[72620]:     <system>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="serial">bc81ba81-361a-4913-8aab-94e1849f992c</entry>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="uuid">bc81ba81-361a-4913-8aab-94e1849f992c</entry>
Aug 09 20:49:20 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:49:20 user nova-compute[72620]:     </system>
Aug 09 20:49:20 user nova-compute[72620]:   </sysinfo>
Aug 09 20:49:20 user nova-compute[72620]:   <os>
Aug 09 20:49:20 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:49:20 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:49:20 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:49:20 user nova-compute[72620]:   </os>
Aug 09 20:49:20 user nova-compute[72620]:   <features>
Aug 09 20:49:20 user nova-compute[72620]:     <acpi/>
Aug 09 20:49:20 user nova-compute[72620]:     <apic/>
Aug 09 20:49:20 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:49:20 user nova-compute[72620]:   </features>
Aug 09 20:49:20 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:49:20 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:49:20 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:49:20 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:49:20 user nova-compute[72620]:   </clock>
Aug 09 20:49:20 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:49:20 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:49:20 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:49:20 user nova-compute[72620]:   </cpu>
Aug 09 20:49:20 user nova-compute[72620]:   <devices>
Aug 09 20:49:20 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:49:20 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:49:20 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk"/>
Aug 09 20:49:20 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:49:20 user nova-compute[72620]:     </disk>
Aug 09 20:49:20 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:49:20 user nova-compute[72620]:       <mac address="fa:16:3e:55:3f:3f"/>
Aug 09 20:49:20 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:49:20 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:49:20 user nova-compute[72620]:       <target dev="tap0204bf3f-57"/>
Aug 09 20:49:20 user nova-compute[72620]:     </interface>
Aug 09 20:49:20 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:49:20 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/console.log" append="off"/>
Aug 09 20:49:20 user nova-compute[72620]:     </serial>
Aug 09 20:49:20 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:49:20 user nova-compute[72620]:     <video>
Aug 09 20:49:20 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:49:20 user nova-compute[72620]:     </video>
Aug 09 20:49:20 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:49:20 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:49:20 user nova-compute[72620]:     </rng>
Aug 09 20:49:20 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:49:20 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:49:20 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:49:20 user nova-compute[72620]:     </memballoon>
Aug 09 20:49:20 user nova-compute[72620]:   </devices>
Aug 09 20:49:20 user nova-compute[72620]: </domain>
Aug 09 20:49:20 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1955171695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:49:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG os_vif [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0204bf3f-57, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0204bf3f-57, col_values=(('external_ids', {'iface-id': '0204bf3f-57ea-46ae-a128-69fb487866ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:3f:3f', 'vm-uuid': 'bc81ba81-361a-4913-8aab-94e1849f992c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:21 user nova-compute[72620]: INFO os_vif [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57')
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No VIF found with MAC fa:16:3e:55:3f:3f, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated VIF entry in instance network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aa61a145-8d0f-464b-bf51-e70184ef44bf req-f95873b3-fc65-4381-a712-05295ba91a80 service nova] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 681574400 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 847249408 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 1025507328 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:22 user nova-compute[72620]: WARNING nova.compute.manager [req-591d0848-a986-4fe9-9eb0-5f6d7ebaf46f req-02001971-adaa-42db-849c-2f374670fe97 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state building and task_state spawning.
Aug 09 20:49:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAYSrdFE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '9882defe-909f-4838-b7d1-b27b7d1f92b8'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[12258a00-55f0-4f05-8e99-ca7ba4574886]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af1ef09-aee1-489d-b518-0e166eaefde5]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 (non-flash)
Aug 09 20:49:23 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305c9120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8'): ({'sdf'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Removing single pathed devices sdf {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74955924-67ff-4637-b775-670ef3c3a20c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c5406-e775-4805-bb47-b46549d93e02]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Flushing IO for device /dev/sdf {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddc050d-0a70-4085-889b-b0456bdd5e27]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9643350-3244-4da6-8e30-146d207542ff]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1961c3-48e7-4e95-82f4-14566897a47a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb817f8-2a7c-4486-a189-c8e3833c5bea]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260]
Aug 09 20:49:23 user nova-compute[72620]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8, portal: 172.16.0.220,3260] successful.
Aug 09 20:49:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9882defe-909f-4838-b7d1-b27b7d1f92b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[835badbc-4252-423f-a578-407f9b25e63c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] <== disconnect_volume: return (324ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0549bece-50e4-414b-945c-1b7338d23a8c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3d5c184-a525-4de4-b675-dca99289d110', 'serial'} {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 09 20:49:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: removing Cinder connection for volume 9882defe-909f-4838-b7d1-b27b7d1f92b8 {{(pid=72620) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] swap_volume: Updating volume 9882defe-909f-4838-b7d1-b27b7d1f92b8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "XoplucGH", "auth_password": "BPWrR7zNgUbulo", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "c3d5c184-a525-4de4-b675-dca99289d110"}, "status": "reserved", "instance": "0549bece-50e4-414b-945c-1b7338d23a8c", "attached_at": "", "detached_at": "", "volume_id": "c3d5c184-a525-4de4-b675-dca99289d110", "serial": "c3d5c184-a525-4de4-b675-dca99289d110"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c3d5c184-a525-4de4-b675-dca99289d110', 'no_device': None, 'attachment_id': 'e7d99dc4-25ce-4a41-9dcd-cdef22c3c307'} {{(pid=72620) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-37b91a2e-79a7-4d6e-a0f7-aad6b38db9f3 tempest-TestVolumeSwap-1236791898 tempest-TestVolumeSwap-1236791898-project-admin] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.114s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614164.8562253, bc81ba81-361a-4913-8aab-94e1849f992c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Resumed (Lifecycle Event)
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance spawned successfully.
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614164.8574018, bc81ba81-361a-4913-8aab-94e1849f992c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Started (Lifecycle Event)
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:24 user nova-compute[72620]: WARNING nova.compute.manager [req-4e606e66-b98f-4fa2-849c-f647cab0b433 req-2e26c946-b01a-4775-aba9-98d099ab6b35 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state building and task_state spawning.
Aug 09 20:49:24 user nova-compute[72620]: INFO nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 09 20:49:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:25 user nova-compute[72620]: INFO nova.compute.manager [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Took 6.67 seconds to build instance.
Aug 09 20:49:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e0134cce-9949-4544-86d2-984da2d877cc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:25 user nova-compute[72620]: INFO nova.compute.manager [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Detaching volume c3d5c184-a525-4de4-b675-dca99289d110
Aug 09 20:49:25 user nova-compute[72620]: INFO nova.virt.block_device [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Attempting to driver detach volume c3d5c184-a525-4de4-b675-dca99289d110 from mountpoint /dev/vdb
Aug 09 20:49:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Attempting to detach device vdb from instance 0549bece-50e4-414b-945c-1b7338d23a8c from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:49:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:49:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:49:25 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:49:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:49:25 user nova-compute[72620]:   <serial>c3d5c184-a525-4de4-b675-dca99289d110</serial>
Aug 09 20:49:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:49:25 user nova-compute[72620]: </disk>
Aug 09 20:49:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:49:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Successfully detached device vdb from instance 0549bece-50e4-414b-945c-1b7338d23a8c from the persistent domain config.
Aug 09 20:49:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0549bece-50e4-414b-945c-1b7338d23a8c from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:49:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:49:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:49:25 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:49:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:49:25 user nova-compute[72620]:   <serial>c3d5c184-a525-4de4-b675-dca99289d110</serial>
Aug 09 20:49:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:49:25 user nova-compute[72620]: </disk>
Aug 09 20:49:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:49:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614166.373219, 0549bece-50e4-414b-945c-1b7338d23a8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:49:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Successfully detached device vdb from instance 0549bece-50e4-414b-945c-1b7338d23a8c from the live domain config.
Aug 09 20:49:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoplucGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'c3d5c184-a525-4de4-b675-dca99289d110'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6cd815-947d-483c-b105-9d49ee47db6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d477a795-b646-4b63-806e-1e158f321bb8]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:26 user nova-compute[72620]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 (non-flash)
Aug 09 20:49:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305a2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a39a4f8-c5fe-4573-8c5b-3f17751ad330]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a26dd-2458-4fde-b3fa-3a730625e1ec]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2c842-534e-4039-91d5-e3bb3fcbd500]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37808c-ec46-4abe-9df6-329a733313a4]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3ff233-2e79-49ad-9779-39ef670e2c0f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b851341-d613-4725-a663-6be01be92635]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260]
Aug 09 20:49:26 user nova-compute[72620]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110, portal: 172.16.0.220,3260] successful.
Aug 09 20:49:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3d5c184-a525-4de4-b675-dca99289d110 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93b49f-2eea-49ff-80a9-74d62441dd20]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] <== disconnect_volume: return (273ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:49:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:27 user nova-compute[72620]: DEBUG nova.objects.instance [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'flavor' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-13d0a833-a34e-4dff-a7b6-7cf42180754a tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.746s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:37 user nova-compute[72620]: INFO nova.compute.manager [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Rescuing
Aug 09 20:49:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:49:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:49:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:49:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:49:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:49:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:38 user nova-compute[72620]: WARNING nova.compute.manager [req-c9e3ac71-93fb-4c0b-a182-77c6b1823a98 req-7fa4411e-60be-402c-91a3-cab7c4c9f5a3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state active and task_state rescuing.
Aug 09 20:49:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance destroyed successfully.
Aug 09 20:49:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Attempting a stable device rescue
Aug 09 20:49:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:49:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Creating image(s)
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:39 user nova-compute[72620]: DEBUG nova.virt.images [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] 4327fd44-e50f-4707-8b27-1c50430364eb was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:49:39 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:49:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.part /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:40 user nova-compute[72620]: WARNING nova.compute.manager [req-9342cea9-ef9c-40de-935c-eece84171931 req-b72d527f-4945-4756-82f5-48113c2b61f5 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state active and task_state rescuing.
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.part /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.converted" returned: 0 in 0.675s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.153s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d,backing_fmt=raw /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d,backing_fmt=raw /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue" returned: 0 in 0.056s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "5c33bcfd73497a7b3b012b48507fb0ee18a2d92d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'migration_context' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start _get_guest_xml network_info=[{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:ae:9c:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4327fd44-e50f-4707-8b27-1c50430364eb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1e3f8155-89ec-4ba8-bb1d-cd5d656870b3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fea6a825-2021-4061-905b-a5a704d67ada', 'serial': 'fea6a825-2021-4061-905b-a5a704d67ada'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '65d48898-54ab-4267-ae93-115ce53e50eb', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:49:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:49:41 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:41 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:49:41 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa87622-7c26-4b67-ac50-fb68d879db36]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = LQEZSXUk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 20:49:41 user nova-compute[72620]: node.name = iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada
Aug 09 20:49:41 user nova-compute[72620]: node.tpgt = -1
Aug 09 20:49:41 user nova-compute[72620]: node.startup = automatic
Aug 09 20:49:41 user nova-compute[72620]: node.leading_login = No
Aug 09 20:49:41 user nova-compute[72620]: iface.iscsi_ifacename = default
Aug 09 20:49:41 user nova-compute[72620]: iface.net_ifacename = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.ipaddress = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.prefix_len = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.hwaddress = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.transport_name = tcp
Aug 09 20:49:41 user nova-compute[72620]: iface.initiatorname = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.vlan_id = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.vlan_priority = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.vlan_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.iface_num = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.mtu = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.port = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.bootproto = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.subnet_mask = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.gateway = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_alt_client_id = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_dns = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_learn_iqn = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_vendor_id_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_vendor_id = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.dhcp_slp_da = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.fragmentation = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.gratuitous_arp = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.incoming_forwarding = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.tos_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.tos = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.ttl = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.delayed_ack = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.tcp_nagle = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.tcp_wsf_state = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.tcp_wsf = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.tcp_timer_scale = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.tcp_timestamp = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.redirect = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.def_task_mgmt_timeout = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.header_digest = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.data_digest = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.immediate_data = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.initial_r2t = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.data_seq_inorder = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.data_pdu_inorder = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.erl = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.max_receive_data_len = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.first_burst_len = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.max_outstanding_r2t = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.max_burst_len = 0
Aug 09 20:49:41 user nova-compute[72620]: iface.chap_auth = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.bidi_chap = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.strict_login_compliance = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.discovery_auth = <empty>
Aug 09 20:49:41 user nova-compute[72620]: iface.discovery_logout = <empty>
Aug 09 20:49:41 user nova-compute[72620]: node.discovery_address = <empty>
Aug 09 20:49:41 user nova-compute[72620]: node.discovery_port = 0
Aug 09 20:49:41 user nova-compute[72620]: node.discovery_type = static
Aug 09 20:49:41 user nova-compute[72620]: node.session.initial_cmdsn = 0
Aug 09 20:49:41 user nova-compute[72620]: node.session.initial_login_retry_max = 8
Aug 09 20:49:41 user nova-compute[72620]: node.session.xmit_thread_priority = -20
Aug 09 20:49:41 user nova-compute[72620]: node.session.cmds_max = 128
Aug 09 20:49:41 user nova-compute[72620]: node.session.queue_depth = 32
Aug 09 20:49:41 user nova-compute[72620]: node.session.nr_sessions = 1
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.authmethod = CHAP
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.username = LQEZSXUk
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.password = ***
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.username_in = <empty>
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.password_in = <empty>
Aug 09 20:49:41 user nova-compute[72620]: node.session.auth.chap_algs = MD5
Aug 09 20:49:41 user nova-compute[72620]: node.session.timeo.replacement_timeout = 120
Aug 09 20:49:41 user nova-compute[72620]: node.session.err_timeo.abort_timeout = 15
Aug 09 20:49:41 user nova-compute[72620]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 20:49:41 user nova-compute[72620]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 20:49:41 user nova-compute[72620]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.FastAbort = Yes
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.InitialR2T = No
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.ImmediateData = Yes
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.MaxConnections = 1
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 20:49:41 user nova-compute[72620]: node.session.iscsi.ERL = 0
Aug 09 20:49:41 user nova-compute[72620]: node.session.scan = manual
Aug 09 20:49:41 user nova-compute[72620]: node.session.reopen_max = 0
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].address = 172.16.0.220
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].port = 3260
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].startup = manual
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].tcp.window_size = 524288
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].tcp.type_of_service = 0
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].timeo.logout_timeout = 15
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].timeo.login_timeout = 15
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].timeo.auth_timeout = 45
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.DataDigest = None
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.IFMarker = No
Aug 09 20:49:41 user nova-compute[72620]: node.conn[0].iscsi.OFMarker = No
Aug 09 20:49:41 user nova-compute[72620]: # END RECORD
Aug 09 20:49:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3aec29-472e-44b3-a05c-e464fe93580c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2af5ff-a67b-45c7-b880-088908292446]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQEZSXUk {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LQEZSXUk" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5985fd-c0eb-4452-9d66-9ce9a2dd0984]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LQEZSXUk'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7d7c1-ae50-429b-9d02-a5261619941b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8bddb4-aa28-4ff4-a276-861ec21b2644]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:41 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:41 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:49:41 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:49:41 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:49:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] HCTL ('33', '0', '0', 0) found on session 17 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ef734f-7b93-4984-964c-d0786bcb2244]: (4, ('0 0 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching for a device in session 17 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.188s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26434623364373061', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434623364373061', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2062598968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2062598968',id=17,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-2vy0pz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:21Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=1e3f8155-89ec-4ba8-bb1d-cd5d656870b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:ae:9c:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:ae:9c:42"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:49:41 user nova-compute[72620]:   <uuid>1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</uuid>
Aug 09 20:49:41 user nova-compute[72620]:   <name>instance-00000011</name>
Aug 09 20:49:41 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:49:41 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:49:41 user nova-compute[72620]:   <metadata>
Aug 09 20:49:41 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:49:41 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2062598968</nova:name>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:49:41</nova:creationTime>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:49:41 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:49:41 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:owner>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:49:41 user nova-compute[72620]:       </nova:owner>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:49:41 user nova-compute[72620]:       <nova:ports>
Aug 09 20:49:41 user nova-compute[72620]:         <nova:port uuid="c5e5d2ea-0d2d-4243-bd26-0777a846d59b">
Aug 09 20:49:41 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 20:49:41 user nova-compute[72620]:         </nova:port>
Aug 09 20:49:41 user nova-compute[72620]:       </nova:ports>
Aug 09 20:49:41 user nova-compute[72620]:     </nova:instance>
Aug 09 20:49:41 user nova-compute[72620]:   </metadata>
Aug 09 20:49:41 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:49:41 user nova-compute[72620]:     <system>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="serial">1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</entry>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="uuid">1e3f8155-89ec-4ba8-bb1d-cd5d656870b3</entry>
Aug 09 20:49:41 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:49:41 user nova-compute[72620]:     </system>
Aug 09 20:49:41 user nova-compute[72620]:   </sysinfo>
Aug 09 20:49:41 user nova-compute[72620]:   <os>
Aug 09 20:49:41 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:49:41 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:49:41 user nova-compute[72620]:   </os>
Aug 09 20:49:41 user nova-compute[72620]:   <features>
Aug 09 20:49:41 user nova-compute[72620]:     <acpi/>
Aug 09 20:49:41 user nova-compute[72620]:     <apic/>
Aug 09 20:49:41 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:49:41 user nova-compute[72620]:   </features>
Aug 09 20:49:41 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:49:41 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:49:41 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:49:41 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:49:41 user nova-compute[72620]:   </clock>
Aug 09 20:49:41 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:49:41 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:49:41 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:49:41 user nova-compute[72620]:   </cpu>
Aug 09 20:49:41 user nova-compute[72620]:   <devices>
Aug 09 20:49:41 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:49:41 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:49:41 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 20:49:41 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:49:41 user nova-compute[72620]:       <serial>fea6a825-2021-4061-905b-a5a704d67ada</serial>
Aug 09 20:49:41 user nova-compute[72620]:     </disk>
Aug 09 20:49:41 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:49:41 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:49:41 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue"/>
Aug 09 20:49:41 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:49:41 user nova-compute[72620]:       <boot order="1"/>
Aug 09 20:49:41 user nova-compute[72620]:     </disk>
Aug 09 20:49:41 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:49:41 user nova-compute[72620]:       <mac address="fa:16:3e:ae:9c:42"/>
Aug 09 20:49:41 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:49:41 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:49:41 user nova-compute[72620]:       <target dev="tapc5e5d2ea-0d"/>
Aug 09 20:49:41 user nova-compute[72620]:     </interface>
Aug 09 20:49:41 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:49:41 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/console.log" append="off"/>
Aug 09 20:49:41 user nova-compute[72620]:     </serial>
Aug 09 20:49:41 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:49:41 user nova-compute[72620]:     <video>
Aug 09 20:49:41 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:49:41 user nova-compute[72620]:     </video>
Aug 09 20:49:41 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:49:41 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:49:41 user nova-compute[72620]:     </rng>
Aug 09 20:49:41 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:49:41 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:49:41 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:49:41 user nova-compute[72620]:     </memballoon>
Aug 09 20:49:41 user nova-compute[72620]:   </devices>
Aug 09 20:49:41 user nova-compute[72620]: </domain>
Aug 09 20:49:41 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:49:41 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance destroyed successfully.
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:ae:9c:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:49:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:43 user nova-compute[72620]: WARNING nova.compute.manager [req-a529f933-525e-4f92-842d-c8d89e73d31b req-aea037e6-890f-407d-8bae-bd0a33f774a9 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state active and task_state rescuing.
Aug 09 20:49:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614185.0374463, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:49:45 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Resumed (Lifecycle Event)
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-04ab7231-4b2d-4883-b7e9-d5c4151f1415 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:49:45 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614185.0417483, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:49:45 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Started (Lifecycle Event)
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:49:45 user nova-compute[72620]: WARNING nova.compute.manager [req-ed80d5db-a2f9-4a6a-845c-4a6077ac78e2 req-d10a379d-6229-45ea-8deb-76fb510baf9f service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state rescued and task_state None.
Aug 09 20:49:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:49:51 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:49:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:49:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:49:58 user nova-compute[72620]: INFO nova.compute.claims [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Claim successful on node user
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:49:58 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.159s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:49:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:49:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Creating image(s)
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.policy [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a62ad594d1d64a5e9c14551b4d87e6e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '017c3a5764804c1ab1c5cde902ed6596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk 1073741824" returned: 0 in 0.050s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Cannot resize image /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Ensure instance console log exists: /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:49:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Successfully created port: c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG nova.objects.instance [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:00 user nova-compute[72620]: INFO nova.compute.manager [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Attaching volume 8782adb1-6ea2-40f5-9b83-d4d69e96718a to /dev/vdb
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ebef16-681a-4d26-913c-fa67a3fad6d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a04d87-0c78-4fff-8fdd-0fa9f5b3d0a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8db2b8-68f8-4f3a-a0a3-f7c6bc400696]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01f4cec-38fe-45fb-b709-312e92462366]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Successfully updated port: c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:50:01 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8395641b-f26c-437e-b4a0-134290f00bfc]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_brick.utils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating existing volume attachment record: 91c510ee-4bfb-4de5-bf90-c044fbbc1d28 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing instance network info cache due to event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance network_info: |[{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start _get_guest_xml network_info=[{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:50:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-660232359',display_name='tempest-ServerRescueNegativeTestJSON-server-660232359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-660232359',id=21,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABgHK6gyY32EYkTOwN0mKoh3lA+sitobdqJ6ObssRsSY/2F1LPDKENlmEerxZI+ot/4+o3MhM1R2A+ou6Jf2S5wiC8HS0dKBS48TQ3SUqPk/Nya8PRS+8Xhx1LvFI6omw==',key_name='tempest-keypair-1015569012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-8o0ar9ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fb3d20c3-8fc1-4661-9da8-d83cd6fced50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.objects.instance [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:50:01 user nova-compute[72620]:   <uuid>fb3d20c3-8fc1-4661-9da8-d83cd6fced50</uuid>
Aug 09 20:50:01 user nova-compute[72620]:   <name>instance-00000015</name>
Aug 09 20:50:01 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:50:01 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:50:01 user nova-compute[72620]:   <metadata>
Aug 09 20:50:01 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:50:01 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-660232359</nova:name>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:50:01</nova:creationTime>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:50:01 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:50:01 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:owner>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:50:01 user nova-compute[72620]:       </nova:owner>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:50:01 user nova-compute[72620]:       <nova:ports>
Aug 09 20:50:01 user nova-compute[72620]:         <nova:port uuid="c9ffb0c1-1a87-4b11-8af8-8e69c996a711">
Aug 09 20:50:01 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 20:50:01 user nova-compute[72620]:         </nova:port>
Aug 09 20:50:01 user nova-compute[72620]:       </nova:ports>
Aug 09 20:50:01 user nova-compute[72620]:     </nova:instance>
Aug 09 20:50:01 user nova-compute[72620]:   </metadata>
Aug 09 20:50:01 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:50:01 user nova-compute[72620]:     <system>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="serial">fb3d20c3-8fc1-4661-9da8-d83cd6fced50</entry>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="uuid">fb3d20c3-8fc1-4661-9da8-d83cd6fced50</entry>
Aug 09 20:50:01 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:50:01 user nova-compute[72620]:     </system>
Aug 09 20:50:01 user nova-compute[72620]:   </sysinfo>
Aug 09 20:50:01 user nova-compute[72620]:   <os>
Aug 09 20:50:01 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:50:01 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:50:01 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:50:01 user nova-compute[72620]:   </os>
Aug 09 20:50:01 user nova-compute[72620]:   <features>
Aug 09 20:50:01 user nova-compute[72620]:     <acpi/>
Aug 09 20:50:01 user nova-compute[72620]:     <apic/>
Aug 09 20:50:01 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:50:01 user nova-compute[72620]:   </features>
Aug 09 20:50:01 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:50:01 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:50:01 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:50:01 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:50:01 user nova-compute[72620]:   </clock>
Aug 09 20:50:01 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:50:01 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:50:01 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:50:01 user nova-compute[72620]:   </cpu>
Aug 09 20:50:01 user nova-compute[72620]:   <devices>
Aug 09 20:50:01 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:50:01 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:50:01 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk"/>
Aug 09 20:50:01 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:50:01 user nova-compute[72620]:     </disk>
Aug 09 20:50:01 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:50:01 user nova-compute[72620]:       <mac address="fa:16:3e:9f:dd:ba"/>
Aug 09 20:50:01 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:01 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:50:01 user nova-compute[72620]:       <target dev="tapc9ffb0c1-1a"/>
Aug 09 20:50:01 user nova-compute[72620]:     </interface>
Aug 09 20:50:01 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:50:01 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/console.log" append="off"/>
Aug 09 20:50:01 user nova-compute[72620]:     </serial>
Aug 09 20:50:01 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:50:01 user nova-compute[72620]:     <video>
Aug 09 20:50:01 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:01 user nova-compute[72620]:     </video>
Aug 09 20:50:01 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:50:01 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:50:01 user nova-compute[72620]:     </rng>
Aug 09 20:50:01 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:50:01 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:50:01 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:50:01 user nova-compute[72620]:     </memballoon>
Aug 09 20:50:01 user nova-compute[72620]:   </devices>
Aug 09 20:50:01 user nova-compute[72620]: </domain>
Aug 09 20:50:01 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-660232359',display_name='tempest-ServerRescueNegativeTestJSON-server-660232359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-660232359',id=21,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABgHK6gyY32EYkTOwN0mKoh3lA+sitobdqJ6ObssRsSY/2F1LPDKENlmEerxZI+ot/4+o3MhM1R2A+ou6Jf2S5wiC8HS0dKBS48TQ3SUqPk/Nya8PRS+8Xhx1LvFI6omw==',key_name='tempest-keypair-1015569012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-8o0ar9ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:49:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fb3d20c3-8fc1-4661-9da8-d83cd6fced50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG os_vif [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9ffb0c1-1a, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9ffb0c1-1a, col_values=(('external_ids', {'iface-id': 'c9ffb0c1-1a87-4b11-8af8-8e69c996a711', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:dd:ba', 'vm-uuid': 'fb3d20c3-8fc1-4661-9da8-d83cd6fced50'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:01 user nova-compute[72620]: INFO os_vif [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a')
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:9f:dd:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updated VIF entry in instance network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44730023-a667-4713-b455-ac73a12ede04 req-e27dd9c2-cd1e-45e7-80ac-6364886a6094 service nova] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614205.229511, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Resumed (Lifecycle Event)
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:05 user nova-compute[72620]: WARNING nova.compute.manager [req-f6a34624-6c5f-43a7-8b4a-948f08608c48 req-655bfd66-124f-479e-af0b-a9754342e87c service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state building and task_state spawning.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:05 user nova-compute[72620]: WARNING nova.compute.manager [req-3aefeb47-0c23-4391-806e-1ad07b92177e req-cb2ea206-8286-41f0-b212-9f4b2e09dc22 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state building and task_state spawning.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance spawned successfully.
Aug 09 20:50:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.299354553222656GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614205.2301722, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Started (Lifecycle Event)
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance e96165b1-5eca-4530-821e-b00b66710ca1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 0549bece-50e4-414b-945c-1b7338d23a8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f549b053-68a4-415c-890b-85aff113aa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:50:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:50:05 user nova-compute[72620]: INFO nova.compute.manager [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Took 7.33 seconds to build instance.
Aug 09 20:50:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14c1f002-36ed-4d6a-a36a-209df8b5d042 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.429s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:10 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:10 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:10 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a39f8-f4c6-4edf-ae89-e9a946019b4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:50:10 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad9a1d3-75eb-41e1-b440-67035427e92e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a] added
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5b985-456e-4f30-bfc7-be673129c8e5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e929e145-3e9d-4704-8f73-2f8ca01d0d8c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGikSUel {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGikSUel" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fdc507-8498-492d-a51e-1c858e7fdd52]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGikSUel'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c19845e-9e6f-4b88-b0d8-dd2840a87789]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0937931-6b79-4d33-a478-9d4080249ea3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f0dca-36c2-4216-a469-f406fc9a57ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]
Aug 09 20:50:10 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7994ae-e09d-49eb-a582-272641bf7658]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259466f-3852-4f4b-9389-cd3c628bf79b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:10 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786efc0-9dba-4c33-80f4-3ba16352ee4a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:50:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23133656365306166', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133656365306166', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:50:11 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:11 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:50:11 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:50:11 user nova-compute[72620]:   <serial>8782adb1-6ea2-40f5-9b83-d4d69e96718a</serial>
Aug 09 20:50:11 user nova-compute[72620]: </disk>
Aug 09 20:50:11 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:50:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:50:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:50:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No VIF found with MAC fa:16:3e:22:d0:38, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:50:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-188e850f-dcdb-4ede-8d3e-621c6622e788 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.529s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:16 user nova-compute[72620]: INFO nova.compute.manager [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Terminating instance
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-unplugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] No waiting events found dispatching network-vif-unplugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-1286b025-dad1-49e9-ab43-5bad3ca93167 req-7a10d4c1-a78f-4c64-8f68-ccce01461418 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-unplugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Instance destroyed successfully.
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lazy-loading 'resources' on Instance uuid 0549bece-50e4-414b-945c-1b7338d23a8c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1585148396',display_name='tempest-TestVolumeSwap-server-1585148396',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1585148396',id=16,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiAVd5aaobHvWa8ajnwTjkXywGgw89H7sHAfz7um2ZLdEDAqnrc2HoOHJ0cR1iAYHwgfnbYoso2Oy+01V/1jfS/JdV7+EYn2NAZYR1zfUbBWHf03brn/f7iSq56YLDc+Q==',key_name='tempest-keypair-2122825614',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc5844e588194631a39dd86e03ab4f8e',ramdisk_id='',reservation_id='r-zuk69g8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1615110503',owner_user_name='tempest-TestVolumeSwap-1615110503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:46:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124600caee0544d7bda3b84ef147de25',uuid=0549bece-50e4-414b-945c-1b7338d23a8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converting VIF {"id": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "address": "fa:16:3e:6e:cd:b8", "network": {"id": "ea72c484-b0df-4edb-8d2d-06c1d0285c66", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1943913308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc5844e588194631a39dd86e03ab4f8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e0ba9d7-39", "ovs_interfaceid": "6e0ba9d7-393f-4ce5-850e-ce72c67ed053", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG os_vif [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e0ba9d7-39, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:16 user nova-compute[72620]: INFO os_vif [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:cd:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053,network=Network(ea72c484-b0df-4edb-8d2d-06c1d0285c66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e0ba9d7-39')
Aug 09 20:50:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Deleting instance files /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c_del
Aug 09 20:50:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Deletion of /opt/stack/data/nova/instances/0549bece-50e4-414b-945c-1b7338d23a8c_del complete
Aug 09 20:50:17 user nova-compute[72620]: INFO nova.compute.manager [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 20:50:17 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:50:17 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:50:17 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:50:17 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:18 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Took 1.00 seconds to deallocate network for instance.
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-d5674555-bd32-4932-9f06-3e80773202c7 req-f9e6ae5e-970e-4916-b809-3c02a7b60d73 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-deleted-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:18 user nova-compute[72620]: INFO nova.compute.manager [req-d5674555-bd32-4932-9f06-3e80773202c7 req-f9e6ae5e-970e-4916-b809-3c02a7b60d73 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Neutron deleted interface 6e0ba9d7-393f-4ce5-850e-ce72c67ed053; detaching it from the instance and deleting it from the info cache
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.network.neutron [req-d5674555-bd32-4932-9f06-3e80773202c7 req-f9e6ae5e-970e-4916-b809-3c02a7b60d73 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-d5674555-bd32-4932-9f06-3e80773202c7 req-f9e6ae5e-970e-4916-b809-3c02a7b60d73 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Detach interface failed, port_id=6e0ba9d7-393f-4ce5-850e-ce72c67ed053, reason: Instance 0549bece-50e4-414b-945c-1b7338d23a8c could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] Acquiring lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] Lock "0549bece-50e4-414b-945c-1b7338d23a8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] No waiting events found dispatching network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:18 user nova-compute[72620]: WARNING nova.compute.manager [req-a5811846-677b-4a01-a686-56b996122a83 req-abd2758d-f0d2-4954-962b-2fcab2fb6a85 service nova] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Received unexpected event network-vif-plugged-6e0ba9d7-393f-4ce5-850e-ce72c67ed053 for instance with vm_state deleted and task_state None.
Aug 09 20:50:18 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Deleted allocations for instance 0549bece-50e4-414b-945c-1b7338d23a8c
Aug 09 20:50:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b91fd137-823f-4389-8c44-38bcd47b9189 tempest-TestVolumeSwap-1615110503 tempest-TestVolumeSwap-1615110503-project-member] Lock "0549bece-50e4-414b-945c-1b7338d23a8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.653s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing instance network info cache due to event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updated VIF entry in instance network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d91dfd8-2bac-497b-af05-1b86fc26ae31 req-bd17a8b7-bd71-4afc-9e9d-9e13757dfca2 service nova] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing instance network info cache due to event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:50:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:50:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updated VIF entry in instance network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:50:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbefe23c-3923-4754-ac48-e2b347e093f1 req-bb1dcff5-9bbb-4cb8-b074-b4cf29cedbf4 service nova] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:30 user nova-compute[72620]: INFO nova.compute.manager [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Terminating instance
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-1bf055f5-4586-4d8c-ae34-a37848b01b37 req-9f5ed85b-30fb-4198-9389-d310a517d3d1 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-unplugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:30 user nova-compute[72620]: INFO nova.compute.manager [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Rebooting instance
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:50:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Instance destroyed successfully.
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lazy-loading 'resources' on Instance uuid e96165b1-5eca-4530-821e-b00b66710ca1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1923729587',display_name='tempest-ServerActionsTestOtherB-server-1923729587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1923729587',id=4,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIEiDcR9IXNgfKBg5DWxTVgmSSRs0/HRa3JihOCLPQyljnxpjb8+bDRRtL+8kXTQzUYyakrfwcT5pqyaH9DvNEocJQZ0wILwYAO1kO6oyRy+Ix6UOynuUnRlRtf/IMHszg==',key_name='tempest-keypair-1765881287',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98aa07c3778141cfbf35d9fd26289d02',ramdisk_id='',reservation_id='r-bumm770i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-257906244',owner_user_name='tempest-ServerActionsTestOtherB-257906244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:48:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5346961c66f84f0cbc929b2de7d72485',uuid=e96165b1-5eca-4530-821e-b00b66710ca1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converting VIF {"id": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "address": "fa:16:3e:d5:05:b1", "network": {"id": "96865e86-cee3-4294-8cf6-a8b0c12e8585", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2066656026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98aa07c3778141cfbf35d9fd26289d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdabb0b-cb", "ovs_interfaceid": "dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG os_vif [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdabb0b-cb, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:30 user nova-compute[72620]: INFO os_vif [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:05:b1,bridge_name='br-int',has_traffic_filtering=True,id=dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd,network=Network(96865e86-cee3-4294-8cf6-a8b0c12e8585),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdabb0b-cb')
Aug 09 20:50:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPCQFNVG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:30 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d823ef5-e645-4c18-b0f6-c89d419acc93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a77695-ba3a-4a07-aa39-eac17f56fa5e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:31 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c504efbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[000bef84-cceb-4b45-8259-d6091b860308]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b1bc3c-68b1-4855-80fa-ff35f5edf5c1]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb943493-5562-4dc8-899c-9b757ff74fd7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d538c3ab-17cf-4cee-bc8d-37728b21fb4e]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8a2607-a174-4acb-9a12-5029aeedd301]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e3b8b-4889-4330-ad94-65fc7bb71e31]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260]
Aug 09 20:50:31 user nova-compute[72620]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c9f7db-f4ad-42b5-9765-0504d3952cdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff6780-9504-4d26-a7af-2591b0c9b2b1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] <== disconnect_volume: return (308ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:50:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Deleting instance files /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_del
Aug 09 20:50:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Deletion of /opt/stack/data/nova/instances/e96165b1-5eca-4530-821e-b00b66710ca1_del complete
Aug 09 20:50:31 user nova-compute[72620]: INFO nova.compute.manager [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614216.9001563, 0549bece-50e4-414b-945c-1b7338d23a8c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:31 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] VM Stopped (Lifecycle Event)
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-4de1d88b-9edc-4503-be6b-5108f6752c11 None None] [instance: 0549bece-50e4-414b-945c-1b7338d23a8c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:31 user nova-compute[72620]: WARNING nova.compute.manager [req-c028bcb7-11fa-477c-9d07-290004f5f5d7 req-7b30d9a8-e32b-400e-b1ff-32d8d4ead910 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 20:50:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance destroyed successfully.
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'resources' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:50:32Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a07b8e0-cf, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:32 user nova-compute[72620]: INFO os_vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf')
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:32 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[211679ac-6ac7-4add-994f-21f9c1d9d132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c9870d-de7d-4d1b-861b-d1648d990547]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5070a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ee7e8-1c8c-4564-89ec-eebae216f6de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Took 1.18 seconds to deallocate network for instance.
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5694f9-e8b5-4a9a-accb-45a6526db42f]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eb7e63-1934-4364-8442-9b050166b7d6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] Acquiring lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] Lock "e96165b1-5eca-4530-821e-b00b66710ca1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] No waiting events found dispatching network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:32 user nova-compute[72620]: WARNING nova.compute.manager [req-b08815ef-7b43-4fff-8dab-0ef95b079721 req-b3806977-a660-46ab-9205-85fa27fe8666 service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received unexpected event network-vif-plugged-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd for instance with vm_state active and task_state deleting.
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c87c1-e62d-4d78-a4c0-14fd8fd156f4]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9bd483-1a6a-43bc-ad28-a28637c90618]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca72f2-95ef-4c02-bebe-68013519a30d]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]
Aug 09 20:50:32 user nova-compute[72620]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be21b34-4dd5-46eb-8d5e-a5bc08640cb9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== disconnect_volume: return (291ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start _get_guest_xml network_info=[{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a99b13de-9dd8-4a36-b85e-3842cbb50df7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'a99b13de-9dd8-4a36-b85e-3842cbb50df7'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f549b053-68a4-415c-890b-85aff113aa9f', 'attached_at': '', 'detached_at': '', 'volume_id': '8782adb1-6ea2-40f5-9b83-d4d69e96718a', 'serial': '8782adb1-6ea2-40f5-9b83-d4d69e96718a'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '91c510ee-4bfb-4de5-bf90-c044fbbc1d28', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:50:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a99b13de-9dd8-4a36-b85e-3842cbb50df7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'vcpu_model' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:32 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:32 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:32 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3b4e3-0df3-4714-bfb6-2bf4967e8d3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:50:32 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ea845-d20a-4370-b7d0-4945c18ca3f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a] added
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af51f81-cf61-4bc1-bee6-36f9514392a8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a23d80a-c8b3-4f71-9eae-d329c11bba1d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGikSUel {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pGikSUel" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9caf3-431a-47fb-a4fe-83edafc5165f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pGikSUel'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecdf2f-0163-4760-ab04-2a66309f3943]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73d502f-e27c-4963-bb1a-66ad74b5818b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:32 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:32 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[20182e35-fb39-47ca-9849-4cf3e160f017]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]
Aug 09 20:50:33 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a4ebd8-fcf1-4a62-88e3-7f51a467f7b5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[992735a2-a2bb-4399-aef9-f3fb0ad2cff2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:33 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:33 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:33 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:33 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b3b73-cefa-46b7-b575-8e058b6dd774]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:50:33 user nova-compute[72620]: INFO nova.compute.manager [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Took 0.86 seconds to detach 1 volumes for instance.
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:33 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Deleted allocations for instance e96165b1-5eca-4530-821e-b00b66710ca1
Aug 09 20:50:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e194d9d5-5fa1-40ed-9360-529e766dc84d tempest-ServerActionsTestOtherB-257906244 tempest-ServerActionsTestOtherB-257906244-project-member] Lock "e96165b1-5eca-4530-821e-b00b66710ca1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.815s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:34 user nova-compute[72620]: WARNING nova.compute.manager [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-43e7ac86-5661-48b4-a361-f0564141b885 req-5ced65fc-ee8a-429a-8f2a-3282b942e8bf service nova] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Received event network-vif-deleted-dfdabb0b-cb85-40d5-8f0d-4b264e58c1fd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23133656365306166', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133656365306166', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:50:32Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'pci_devices' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:50:34 user nova-compute[72620]:   <uuid>f549b053-68a4-415c-890b-85aff113aa9f</uuid>
Aug 09 20:50:34 user nova-compute[72620]:   <name>instance-00000012</name>
Aug 09 20:50:34 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:50:34 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:50:34 user nova-compute[72620]:   <metadata>
Aug 09 20:50:34 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:50:34 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:name>tempest-TestMinimumBasicScenario-server-808070253</nova:name>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:50:32</nova:creationTime>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:50:34 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:50:34 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:owner>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:user uuid="93ec7531ffb048959bb3d9e47eba8485">tempest-TestMinimumBasicScenario-931784319-project-member</nova:user>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:project uuid="4fe04d8fa9624440a7e46af39c41a498">tempest-TestMinimumBasicScenario-931784319</nova:project>
Aug 09 20:50:34 user nova-compute[72620]:       </nova:owner>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:root type="image" uuid="a99b13de-9dd8-4a36-b85e-3842cbb50df7"/>
Aug 09 20:50:34 user nova-compute[72620]:       <nova:ports>
Aug 09 20:50:34 user nova-compute[72620]:         <nova:port uuid="1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f">
Aug 09 20:50:34 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:50:34 user nova-compute[72620]:         </nova:port>
Aug 09 20:50:34 user nova-compute[72620]:       </nova:ports>
Aug 09 20:50:34 user nova-compute[72620]:     </nova:instance>
Aug 09 20:50:34 user nova-compute[72620]:   </metadata>
Aug 09 20:50:34 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:50:34 user nova-compute[72620]:     <system>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="serial">f549b053-68a4-415c-890b-85aff113aa9f</entry>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="uuid">f549b053-68a4-415c-890b-85aff113aa9f</entry>
Aug 09 20:50:34 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:50:34 user nova-compute[72620]:     </system>
Aug 09 20:50:34 user nova-compute[72620]:   </sysinfo>
Aug 09 20:50:34 user nova-compute[72620]:   <os>
Aug 09 20:50:34 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:50:34 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:50:34 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:50:34 user nova-compute[72620]:   </os>
Aug 09 20:50:34 user nova-compute[72620]:   <features>
Aug 09 20:50:34 user nova-compute[72620]:     <acpi/>
Aug 09 20:50:34 user nova-compute[72620]:     <apic/>
Aug 09 20:50:34 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:50:34 user nova-compute[72620]:   </features>
Aug 09 20:50:34 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:50:34 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:50:34 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:50:34 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:50:34 user nova-compute[72620]:   </clock>
Aug 09 20:50:34 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:50:34 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:50:34 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:50:34 user nova-compute[72620]:   </cpu>
Aug 09 20:50:34 user nova-compute[72620]:   <devices>
Aug 09 20:50:34 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:50:34 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:50:34 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk"/>
Aug 09 20:50:34 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:50:34 user nova-compute[72620]:     </disk>
Aug 09 20:50:34 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:50:34 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:34 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:50:34 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:50:34 user nova-compute[72620]:       <serial>8782adb1-6ea2-40f5-9b83-d4d69e96718a</serial>
Aug 09 20:50:34 user nova-compute[72620]:     </disk>
Aug 09 20:50:34 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:50:34 user nova-compute[72620]:       <mac address="fa:16:3e:22:d0:38"/>
Aug 09 20:50:34 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:34 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:50:34 user nova-compute[72620]:       <target dev="tap1a07b8e0-cf"/>
Aug 09 20:50:34 user nova-compute[72620]:     </interface>
Aug 09 20:50:34 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:50:34 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/console.log" append="off"/>
Aug 09 20:50:34 user nova-compute[72620]:     </serial>
Aug 09 20:50:34 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:50:34 user nova-compute[72620]:     <video>
Aug 09 20:50:34 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:34 user nova-compute[72620]:     </video>
Aug 09 20:50:34 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:50:34 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:50:34 user nova-compute[72620]:     </rng>
Aug 09 20:50:34 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:50:34 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:50:34 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:50:34 user nova-compute[72620]:     </memballoon>
Aug 09 20:50:34 user nova-compute[72620]:   </devices>
Aug 09 20:50:34 user nova-compute[72620]: </domain>
Aug 09 20:50:34 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'info_cache' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'trusted_certs' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing instance network info cache due to event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] Acquiring lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] Acquired lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 --force-share --output=json" returned: 0 in 0.165s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Cannot resize image /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'migration_context' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:50:32Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG os_vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a07b8e0-cf, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a07b8e0-cf, col_values=(('external_ids', {'iface-id': '1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:d0:38', 'vm-uuid': 'f549b053-68a4-415c-890b-85aff113aa9f'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:34 user nova-compute[72620]: INFO os_vif [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf')
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance destroyed successfully.
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'resources' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33d0fedc-a4, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:35 user nova-compute[72620]: INFO os_vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0a605-81c5-425d-9287-a3cb131f728c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac89cb5-f21a-4262-9352-7b0e6c440b6c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305bd630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5281bd-92ac-4255-bb71-709458938be7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[666dc7ee-cdd6-41bc-9d68-983d27923e51]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1966122-b8a9-4f83-b7c8-84d125c10d94]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updated VIF entry in instance network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[490b622b-ce9b-42e3-8fad-292f1382d444]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-60e7992d-8133-4bdf-817e-9b0e29e9d124 req-96834f36-dc6e-47f2-950c-b063e5ca1edf service nova] Releasing lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c500d-33ec-42eb-ab79-94d002ff16e7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:35 user nova-compute[72620]: INFO nova.compute.manager [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Attaching volume 10124951-33e3-421a-b2f4-be931349488a to /dev/vdb
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[245363a5-d428-4eeb-89f4-a390eb35aeae]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]
Aug 09 20:50:35 user nova-compute[72620]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e8d6b7-d9ed-4721-aea4-44f13124ca70]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== disconnect_volume: return (328ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start _get_guest_xml network_info=[{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c5872c41-5db7-42aa-9145-108eec912a53', 'attached_at': '', 'detached_at': '', 'volume_id': '224a834a-cc1c-4891-ad45-87a17743e10f', 'serial': '224a834a-cc1c-4891-ad45-87a17743e10f'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'be614e86-32ce-47eb-b4f9-00c3c30ad2a2', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'numa_topology' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.utils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80b8c7-3d8e-4735-ba9a-15e064968cd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:35 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[09caddf2-2dff-4b21-80cd-9aa30a40e8ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d348af3-b0e7-482c-b9e3-eeff97bfc133]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:50:35 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef7e32e-9d78-4809-9555-9fea4f8e414b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[886285a2-13a2-49ab-ab61-fda36954b6a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a092e9-fffb-4d0a-9e64-8bc8dcd62d04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f] added
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:50:35 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5e9feb-5e92-4a09-902d-c576d436b8c3]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.utils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating existing volume attachment record: 4ce65299-9c7e-4513-b36c-337cd35c9ea5 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae7f1b-5f35-4f15-a9a3-a732e4f781a0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6678c17-888e-42c6-8617-7c3f98aad279]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEBfUXxH {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MEBfUXxH" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0808efe-f0d2-4ef0-8d74-4e8928090626]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MEBfUXxH'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf65373-b84e-4276-8f33-9640cd8d8ea8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e51d1a-a3c4-4b80-9151-a02cf08a3ff1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:35 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454eb53-9711-4aa0-ab19-803cd2153aa5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]
Aug 09 20:50:35 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccebb40-07fc-4d04-8632-d12ebfdf21cf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762b449-702c-4817-b5b6-c5bbf6c11cae]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:36 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:36 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:36 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:36 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccea4eed-ec8a-4fe7-a7ef-e998bdcef43a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:36 user nova-compute[72620]: WARNING nova.compute.manager [req-77337dbd-6ab6-41e2-b94c-330e744a1f4c req-1fceff5f-1e25-4eb5-baec-feb81d90dc15 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state active and task_state reboot_started_hard.
Aug 09 20:50:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23833363762373034', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833363762373034', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'pci_devices' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:50:37 user nova-compute[72620]:   <uuid>c5872c41-5db7-42aa-9145-108eec912a53</uuid>
Aug 09 20:50:37 user nova-compute[72620]:   <name>instance-0000000f</name>
Aug 09 20:50:37 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:50:37 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:50:37 user nova-compute[72620]:   <metadata>
Aug 09 20:50:37 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:50:37 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeTestJSON-server-1990795843</nova:name>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:50:35</nova:creationTime>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:50:37 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:50:37 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:owner>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:user uuid="e7b0bb7bc6434f0b81a7479269348a72">tempest-AttachVolumeTestJSON-12994001-project-member</nova:user>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:project uuid="47da24a245bc4b0e9eb5cb14adf689d6">tempest-AttachVolumeTestJSON-12994001</nova:project>
Aug 09 20:50:37 user nova-compute[72620]:       </nova:owner>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:50:37 user nova-compute[72620]:       <nova:ports>
Aug 09 20:50:37 user nova-compute[72620]:         <nova:port uuid="33d0fedc-a465-457a-959d-c054e1e8a0e4">
Aug 09 20:50:37 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:50:37 user nova-compute[72620]:         </nova:port>
Aug 09 20:50:37 user nova-compute[72620]:       </nova:ports>
Aug 09 20:50:37 user nova-compute[72620]:     </nova:instance>
Aug 09 20:50:37 user nova-compute[72620]:   </metadata>
Aug 09 20:50:37 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:50:37 user nova-compute[72620]:     <system>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="serial">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="uuid">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:50:37 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:50:37 user nova-compute[72620]:     </system>
Aug 09 20:50:37 user nova-compute[72620]:   </sysinfo>
Aug 09 20:50:37 user nova-compute[72620]:   <os>
Aug 09 20:50:37 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:50:37 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:50:37 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:50:37 user nova-compute[72620]:   </os>
Aug 09 20:50:37 user nova-compute[72620]:   <features>
Aug 09 20:50:37 user nova-compute[72620]:     <acpi/>
Aug 09 20:50:37 user nova-compute[72620]:     <apic/>
Aug 09 20:50:37 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:50:37 user nova-compute[72620]:   </features>
Aug 09 20:50:37 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:50:37 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:50:37 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:50:37 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:50:37 user nova-compute[72620]:   </clock>
Aug 09 20:50:37 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:50:37 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:50:37 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:50:37 user nova-compute[72620]:   </cpu>
Aug 09 20:50:37 user nova-compute[72620]:   <devices>
Aug 09 20:50:37 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:50:37 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:50:37 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk"/>
Aug 09 20:50:37 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:50:37 user nova-compute[72620]:     </disk>
Aug 09 20:50:37 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:50:37 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:37 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 20:50:37 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:50:37 user nova-compute[72620]:       <serial>224a834a-cc1c-4891-ad45-87a17743e10f</serial>
Aug 09 20:50:37 user nova-compute[72620]:     </disk>
Aug 09 20:50:37 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:50:37 user nova-compute[72620]:       <mac address="fa:16:3e:aa:60:d6"/>
Aug 09 20:50:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:37 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:50:37 user nova-compute[72620]:       <target dev="tap33d0fedc-a4"/>
Aug 09 20:50:37 user nova-compute[72620]:     </interface>
Aug 09 20:50:37 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:50:37 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/console.log" append="off"/>
Aug 09 20:50:37 user nova-compute[72620]:     </serial>
Aug 09 20:50:37 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:50:37 user nova-compute[72620]:     <video>
Aug 09 20:50:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:50:37 user nova-compute[72620]:     </video>
Aug 09 20:50:37 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:50:37 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:50:37 user nova-compute[72620]:     </rng>
Aug 09 20:50:37 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:50:37 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:50:37 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:50:37 user nova-compute[72620]:     </memballoon>
Aug 09 20:50:37 user nova-compute[72620]:   </devices>
Aug 09 20:50:37 user nova-compute[72620]: </domain>
Aug 09 20:50:37 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Cannot resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'migration_context' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:48:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG os_vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33d0fedc-a4, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33d0fedc-a4, col_values=(('external_ids', {'iface-id': '33d0fedc-a465-457a-959d-c054e1e8a0e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:60:d6', 'vm-uuid': 'c5872c41-5db7-42aa-9145-108eec912a53'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:50:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:37 user nova-compute[72620]: INFO os_vif [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for f549b053-68a4-415c-890b-85aff113aa9f due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614238.6351228, f549b053-68a4-415c-890b-85aff113aa9f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:38 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] VM Resumed (Lifecycle Event)
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:50:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance rebooted successfully.
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:38 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614238.637544, f549b053-68a4-415c-890b-85aff113aa9f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:38 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] VM Started (Lifecycle Event)
Aug 09 20:50:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3e5e275c-d634-45c1-ae96-897699d0847f tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.940s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:39 user nova-compute[72620]: WARNING nova.compute.manager [req-aaff1b1d-47d6-4c40-bc61-d19dcc29da1b req-cf7e6597-934c-443f-8046-a2f46f38ab42 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state active and task_state None.
Aug 09 20:50:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:39 user nova-compute[72620]: WARNING nova.compute.manager [req-5d81fe31-8d89-499e-8335-fe7b2b9c6d36 req-7cb0c0fd-53f1-4dcf-869b-4c0c9fd25f55 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state powering-on.
Aug 09 20:50:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:50:41 user nova-compute[72620]: WARNING nova.compute.manager [req-475a9428-bd82-4a5c-be3b-c6d6ba4e59c6 req-493d591f-a0d2-4880-b3cf-5aeb904074ab service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state powering-on.
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614241.875204, c5872c41-5db7-42aa-9145-108eec912a53 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:41 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Resumed (Lifecycle Event)
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:50:41 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance rebooted successfully.
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6916bfb0-adbd-4aa1-96a2-e993ca847e36 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:41 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614241.876389, c5872c41-5db7-42aa-9145-108eec912a53 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:41 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Started (Lifecycle Event)
Aug 09 20:50:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:50:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMVSByt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:45 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f8789-f6d8-4751-bde5-efebcfd12f98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:50:45 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.089s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c36aca-af93-40e6-ac0d-16b05b73fe4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a] added
Aug 09 20:50:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[091d938e-87d6-4012-8b15-ba547f0d61a6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c4754-3d30-492c-9aac-31f6a91e1297]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKMVSByt {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614230.8793662, e96165b1-5eca-4530-821e-b00b66710ca1 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:50:45 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] VM Stopped (Lifecycle Event)
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AKMVSByt" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca1a39b-d5f5-449a-b3a8-c7e699a14660]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AKMVSByt'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-83708011-eac7-4f46-91ff-3fe22063e30a None None] [instance: e96165b1-5eca-4530-821e-b00b66710ca1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[de81c047-0150-4d72-b4ac-0663451d3189]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[91269e4a-522e-474a-9ccf-6d5526d8fb2f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:45 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:45 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:45 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:45 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427cb30-25fc-464d-b51c-c2525bf42f50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260]
Aug 09 20:50:46 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f95f4-465a-4ed0-a1fc-5e4dad45e1bc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76cdbc-949a-43ca-bbdf-79fc075e08f9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)
Aug 09 20:50:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:46 user nova-compute[72620]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)
Aug 09 20:50:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b773af-572d-4abf-ae4d-081fb8630dd6]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMVSByt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:50:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23163316430646535', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163316430646535', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.objects.instance [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:50:47 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:47 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:50:47 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:50:47 user nova-compute[72620]:   <serial>10124951-33e3-421a-b2f4-be931349488a</serial>
Aug 09 20:50:47 user nova-compute[72620]: </disk>
Aug 09 20:50:47 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No VIF found with MAC fa:16:3e:e8:13:22, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7fbe5eca-b8a7-4784-8c59-9933a10b4275 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.212s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:50 user nova-compute[72620]: INFO nova.compute.manager [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Detaching volume 10124951-33e3-421a-b2f4-be931349488a
Aug 09 20:50:50 user nova-compute[72620]: INFO nova.virt.block_device [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Attempting to driver detach volume 10124951-33e3-421a-b2f4-be931349488a from mountpoint /dev/vdb
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Attempting to detach device vdb from instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:50:50 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:50 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:50:50 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:50:50 user nova-compute[72620]:   <serial>10124951-33e3-421a-b2f4-be931349488a</serial>
Aug 09 20:50:50 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:50:50 user nova-compute[72620]: </disk>
Aug 09 20:50:50 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:50:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully detached device vdb from instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 from the persistent domain config.
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:50:50 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:50:50 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:50:50 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:50:50 user nova-compute[72620]:   <serial>10124951-33e3-421a-b2f4-be931349488a</serial>
Aug 09 20:50:50 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:50:50 user nova-compute[72620]: </disk>
Aug 09 20:50:50 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614250.870309, 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:50:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully detached device vdb from instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 from the live domain config.
Aug 09 20:50:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AKMVSByt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:50:50 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[320d46e9-ee1e-4b90-9954-ae3f62b80466]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695d5b9-1feb-4c29-9979-eee723247056]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)
Aug 09 20:50:50 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:50:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:50:50 user nova-compute[72620]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a (non-flash)
Aug 09 20:50:50 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5075cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[61abdc5d-03ac-428b-ba30-85f7a5448aa5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b3aaa7-8678-4f95-b3dd-7cee977eee9b]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[00536247-adc7-4514-bb5d-07a956cbe9b9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[442ec819-da72-42a9-9944-cb6609858161]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c87f6ee-4103-4b6f-81f7-74e3fcdf52ee]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4911d33d-117d-41dc-8c15-d3179dc340b4]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260]
Aug 09 20:50:51 user nova-compute[72620]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a, portal: 172.16.0.220,3260] successful.
Aug 09 20:50:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10124951-33e3-421a-b2f4-be931349488a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd7767-4d4f-4ef9-981c-d53c4033ad20]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== disconnect_volume: return (295ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:50:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b6d59438-cc6a-4a74-866a-8e0abc28846b tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:50:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:50:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [{"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:50:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-fd67d539-7cdf-4abc-a32e-d98f6be67e1b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:50:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:50:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:50:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:50:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:51:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7352MB free_disk=25.312740325927734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f549b053-68a4-415c-890b-85aff113aa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:51:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing instance network info cache due to event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:51:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:09 user nova-compute[72620]: DEBUG nova.network.neutron [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:51:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated VIF entry in instance network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:51:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7cdd775f-7998-40d6-bd21-28a5dcd75d67 req-e98f5fb6-6ee4-4989-860d-560653e7f0c8 service nova] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:28 user nova-compute[72620]: INFO nova.compute.manager [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Unrescuing
Aug 09 20:51:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:28 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'flavor' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:51:29 user nova-compute[72620]: WARNING nova.compute.manager [req-916fe27d-465a-4a61-aa83-c8148f0a5d5b req-92f2a078-5db7-4b4b-8cb6-15488f6063e3 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:51:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance destroyed successfully.
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:51:31 user nova-compute[72620]: WARNING nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:51:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:51:31 user nova-compute[72620]: WARNING nova.compute.manager [req-39af7142-f36d-4334-9c4e-4409a1a835a7 req-79869db4-ca7a-4960-9169-0115e2a480b4 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:51:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614293.752643, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:51:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Resumed (Lifecycle Event)
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6ed3f180-cd25-4e0e-a5c3-8a3af1c46c4a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:51:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614293.754326, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:51:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Started (Lifecycle Event)
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:51:33 user nova-compute[72620]: WARNING nova.compute.manager [req-a6215d26-9a0d-4976-80a4-902bd99c692a req-9e3713eb-98db-4988-8a99-fa083f74b681 service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state active and task_state None.
Aug 09 20:51:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:51:49 user nova-compute[72620]: INFO nova.compute.manager [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] instance snapshotting
Aug 09 20:51:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Beginning live snapshot process
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing instance network info cache due to event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b.delta 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b.delta 1073741824" returned: 0 in 0.184s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG nova.objects.instance [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'flavor' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:50 user nova-compute[72620]: INFO nova.compute.manager [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Attaching volume 4f666b5d-87f2-4514-a225-45d43b237fc1 to /dev/vdb
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5f7f6-485a-4803-9254-0a147e0fda29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d31da91-5e47-47ca-8d16-548f55b16b12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0383a-6638-4d5a-8210-012392a74ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e72b88-1a2e-48ec-af51-f9e66fc63739]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:51:50 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1aebe-0cf6-4a03-a398-4202000dea6c]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG os_brick.utils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating existing volume attachment record: 6d69f1db-846d-4456-9db3-cfb38f91df0f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:51:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] COPY block job progress, current cursor: 24838144 final cursor: 75563008 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:51:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updated VIF entry in instance network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:51:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-192fdf34-2638-44d4-8bd3-e25cdf229824 req-2385eb8d-0243-4236-96cd-a7a500e6a59f service nova] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:51:51 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 20:51:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b.delta /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b.delta /opt/stack/data/nova/instances/snapshots/tmp5wuiijv2/4b445b260bdd4e718b296054f752cb6b" returned: 0 in 0.583s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Snapshot extracted, beginning image upload
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:51:52 user nova-compute[72620]: INFO nova.compute.claims [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Claim successful on node user
Aug 09 20:51:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:51:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:51:53 user nova-compute[72620]: INFO nova.virt.block_device [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Booting with volume 54d88d46-071f-4ae4-9884-61011298d7ee at /dev/vda
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.policy [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dff7b04b13c74b37b5173df56d20243d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f8a02e7fda64d4c9b0bde7b090bd821', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.utils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[141485ff-cb59-4a63-97ef-a49cb2e73e03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f360ab57-540f-451a-aeee-421db3080499]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da14571-cf41-4f9f-85b6-d9dffd7b376e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f18aaa-7e8d-4b7a-875b-84e2f33eb23b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:51:53 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[38faad98-e63a-45ca-9a97-4c75a4ae5d20]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG os_brick.utils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating existing volume attachment record: f53c2499-b996-4ac3-a3ea-e291d3d8604e {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:51:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Successfully created port: f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:51:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Successfully updated port: f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquired lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:51:55 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Snapshot image upload complete
Aug 09 20:51:55 user nova-compute[72620]: INFO nova.compute.manager [None req-c677ad8d-066f-4260-a1b8-9a8b429010a0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Took 6.53 seconds to snapshot the instance on the hypervisor.
Aug 09 20:51:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-changed-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Refreshing instance network info cache due to event network-changed-f57f6189-a1dc-4a63-81e8-eb0c376f34a4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:51:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] Acquiring lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating instance_info_cache with network_info: [{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Releasing lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance network_info: |[{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] Acquired lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Refreshing network info cache for port f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updated VIF entry in instance network info cache for port f57f6189-a1dc-4a63-81e8-eb0c376f34a4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating instance_info_cache with network_info: [{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d45b333-e8ed-4cf0-909b-90ca3c194748 req-7fcedbe7-3ff5-47c2-becc-599d8f678051 service nova] Releasing lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:51:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:51:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:58 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:51:58 user nova-compute[72620]: INFO nova.compute.claims [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Claim successful on node user
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:51:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.policy [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99eca3cb88e349c38b46fdd75ad21c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355c9ed1b3bf41c79a2e58158b3469d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:51:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Creating image(s)
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "/opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "/opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "448db4caffadba574c2e790b019f18ad8f525fa5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:51:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "448db4caffadba574c2e790b019f18ad8f525fa5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Successfully created port: a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG nova.virt.images [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] 95a8c17d-ef8d-4053-ae14-c0cb4b04d284 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:52:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.part /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbLDghiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:01 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:01 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:01 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8529cb16-fff1-4156-b21e-9ad99724c6db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:52:01 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff64e2-4213-4d7d-a152-7aae279d6980]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1] added
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db31623-47f3-4ae2-aec4-339ed3dbef77]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2732e56-2593-4dcd-93bc-ecf66d73533f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbLDghiP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FbLDghiP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e765ece-c927-476b-80d4-b8ad55023b5e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.part /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.converted" returned: 0 in 0.274s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FbLDghiP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ab344e-e962-4ef7-b504-a8935328f064]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0b308c-c41d-4d03-95b0-cf12d80360d6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16804f9-60dd-42da-86cf-afb77e3f8e6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260]
Aug 09 20:52:01 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260] successful.
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "448db4caffadba574c2e790b019f18ad8f525fa5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.908s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[887f302e-7b27-4c3b-a273-8c897ea88cb9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[619e282b-bc51-431f-9aeb-a072775f763a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.481s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198fb54-a04d-4750-8449-4648920d9fdc]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbLDghiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "448db4caffadba574c2e790b019f18ad8f525fa5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "448db4caffadba574c2e790b019f18ad8f525fa5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5,backing_fmt=raw /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5,backing_fmt=raw /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk 1073741824" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "448db4caffadba574c2e790b019f18ad8f525fa5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Successfully updated port: a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:52:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing instance network info cache due to event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] Acquiring lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] Acquired lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing network info cache for port a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 --force-share --output=json" returned: 0 in 0.179s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'migration_context' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Ensure instance console log exists: /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a67651f-ebec-46c1-a397-48973d9ccb9f req-1a3a1165-ffd9-4ab5-a6a8-afeac2cb5ff7 service nova] Releasing lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquired lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.564s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] <== connect_volume: return (1567ms) {'type': 'block', 'scsi_wwn': '26262666461366365', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262666461366365', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'flavor' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:52:02 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:02 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:52:02 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:52:02 user nova-compute[72620]:   <serial>4f666b5d-87f2-4514-a225-45d43b237fc1</serial>
Aug 09 20:52:02 user nova-compute[72620]: </disk>
Aug 09 20:52:02 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating instance_info_cache with network_info: [{"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Releasing lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance network_info: |[{"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Start _get_guest_xml network_info=[{"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e7e335caa3a867973a7b76d781db8b4d',container_format='bare',created_at=2023-08-09T20:51:49Z,direct_url=<?>,disk_format='qcow2',id=95a8c17d-ef8d-4053-ae14-c0cb4b04d284,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-792257211',owner='355c9ed1b3bf41c79a2e58158b3469d6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T20:51:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': '95a8c17d-ef8d-4053-ae14-c0cb4b04d284'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:02 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:02 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e7e335caa3a867973a7b76d781db8b4d',container_format='bare',created_at=2023-08-09T20:51:49Z,direct_url=<?>,disk_format='qcow2',id=95a8c17d-ef8d-4053-ae14-c0cb4b04d284,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-792257211',owner='355c9ed1b3bf41c79a2e58158b3469d6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T20:51:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:52:02 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-836806542',display_name='tempest-TestStampPattern-server-836806542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-836806542',id=23,image_ref='95a8c17d-ef8d-4053-ae14-c0cb4b04d284',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-0d16qi2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7b0d54ec-1ee4-498d-adb0-68f98faa4db5',image_min_disk='1',image_min_ram='0',image_owner_id='355c9ed1b3bf41c79a2e58158b3469d6',image_owner_project_name='tempest-TestStampPattern-1200029945',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1200029945-project-member',image_user_id='99eca3cb88e349c38b46fdd75ad21c69',network_allocated='True',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:51:59Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=f6fbe0e3-8e6a-48d4-941a-b7046c225fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'pci_devices' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:52:03 user nova-compute[72620]:   <uuid>f6fbe0e3-8e6a-48d4-941a-b7046c225fad</uuid>
Aug 09 20:52:03 user nova-compute[72620]:   <name>instance-00000017</name>
Aug 09 20:52:03 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:52:03 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:52:03 user nova-compute[72620]:   <metadata>
Aug 09 20:52:03 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:52:03 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:name>tempest-TestStampPattern-server-836806542</nova:name>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:52:02</nova:creationTime>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:52:03 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:52:03 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:owner>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:user uuid="99eca3cb88e349c38b46fdd75ad21c69">tempest-TestStampPattern-1200029945-project-member</nova:user>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:project uuid="355c9ed1b3bf41c79a2e58158b3469d6">tempest-TestStampPattern-1200029945</nova:project>
Aug 09 20:52:03 user nova-compute[72620]:       </nova:owner>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:root type="image" uuid="95a8c17d-ef8d-4053-ae14-c0cb4b04d284"/>
Aug 09 20:52:03 user nova-compute[72620]:       <nova:ports>
Aug 09 20:52:03 user nova-compute[72620]:         <nova:port uuid="a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7">
Aug 09 20:52:03 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:52:03 user nova-compute[72620]:         </nova:port>
Aug 09 20:52:03 user nova-compute[72620]:       </nova:ports>
Aug 09 20:52:03 user nova-compute[72620]:     </nova:instance>
Aug 09 20:52:03 user nova-compute[72620]:   </metadata>
Aug 09 20:52:03 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:52:03 user nova-compute[72620]:     <system>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="serial">f6fbe0e3-8e6a-48d4-941a-b7046c225fad</entry>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="uuid">f6fbe0e3-8e6a-48d4-941a-b7046c225fad</entry>
Aug 09 20:52:03 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:52:03 user nova-compute[72620]:     </system>
Aug 09 20:52:03 user nova-compute[72620]:   </sysinfo>
Aug 09 20:52:03 user nova-compute[72620]:   <os>
Aug 09 20:52:03 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:52:03 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:52:03 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:52:03 user nova-compute[72620]:   </os>
Aug 09 20:52:03 user nova-compute[72620]:   <features>
Aug 09 20:52:03 user nova-compute[72620]:     <acpi/>
Aug 09 20:52:03 user nova-compute[72620]:     <apic/>
Aug 09 20:52:03 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:52:03 user nova-compute[72620]:   </features>
Aug 09 20:52:03 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:52:03 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:52:03 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:52:03 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:52:03 user nova-compute[72620]:   </clock>
Aug 09 20:52:03 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:52:03 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:52:03 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:52:03 user nova-compute[72620]:   </cpu>
Aug 09 20:52:03 user nova-compute[72620]:   <devices>
Aug 09 20:52:03 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:52:03 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:52:03 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk"/>
Aug 09 20:52:03 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:52:03 user nova-compute[72620]:     </disk>
Aug 09 20:52:03 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:52:03 user nova-compute[72620]:       <mac address="fa:16:3e:b2:6e:a6"/>
Aug 09 20:52:03 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:03 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:52:03 user nova-compute[72620]:       <target dev="tapa7c4b3b1-bf"/>
Aug 09 20:52:03 user nova-compute[72620]:     </interface>
Aug 09 20:52:03 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:52:03 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/console.log" append="off"/>
Aug 09 20:52:03 user nova-compute[72620]:     </serial>
Aug 09 20:52:03 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:52:03 user nova-compute[72620]:     <video>
Aug 09 20:52:03 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:03 user nova-compute[72620]:     </video>
Aug 09 20:52:03 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:52:03 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:52:03 user nova-compute[72620]:     </rng>
Aug 09 20:52:03 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:52:03 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:52:03 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:52:03 user nova-compute[72620]:     </memballoon>
Aug 09 20:52:03 user nova-compute[72620]:   </devices>
Aug 09 20:52:03 user nova-compute[72620]: </domain>
Aug 09 20:52:03 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-836806542',display_name='tempest-TestStampPattern-server-836806542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-836806542',id=23,image_ref='95a8c17d-ef8d-4053-ae14-c0cb4b04d284',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-0d16qi2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7b0d54ec-1ee4-498d-adb0-68f98faa4db5',image_min_disk='1',image_min_ram='0',image_owner_id='355c9ed1b3bf41c79a2e58158b3469d6',image_owner_project_name='tempest-TestStampPattern-1200029945',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1200029945-project-member',image_user_id='99eca3cb88e349c38b46fdd75ad21c69',network_allocated='True',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:51:59Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=f6fbe0e3-8e6a-48d4-941a-b7046c225fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG os_vif [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7c4b3b1-bf, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7c4b3b1-bf, col_values=(('external_ids', {'iface-id': 'a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:6e:a6', 'vm-uuid': 'f6fbe0e3-8e6a-48d4-941a-b7046c225fad'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:03 user nova-compute[72620]: INFO os_vif [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf')
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No VIF found with MAC fa:16:3e:b2:6e:a6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:9f:dd:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-14837fde-1a7d-4ac1-9202-9e4f58cd54ec tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.031s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:52:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:04 user nova-compute[72620]: INFO nova.compute.manager [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Rescuing
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:52:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Creating image(s)
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Ensure instance console log exists: /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start _get_guest_xml network_info=[{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23220e25-c7e8-4419-b412-555200a63f31', 'attached_at': '', 'detached_at': '', 'volume_id': '54d88d46-071f-4ae4-9884-61011298d7ee', 'serial': '54d88d46-071f-4ae4-9884-61011298d7ee'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'f53c2499-b996-4ac3-a3ea-e291d3d8604e', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:52:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:04 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:04 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:04 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f2987-6d83-4a44-9afe-1b8b97772154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:52:04 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36538e0-a84a-4fb6-a0ec-8dc2c7c21c83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee] added
Aug 09 20:52:04 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c89c4-ec41-45bb-8a39-9fc70e912712]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614326.979601, f6fbe0e3-8e6a-48d4-941a-b7046c225fad => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] VM Resumed (Lifecycle Event)
Aug 09 20:52:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] No waiting events found dispatching network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:07 user nova-compute[72620]: WARNING nova.compute.manager [req-b3859b89-5364-463b-bca8-5455bb49bf3c req-8598fb14-6c5f-4ae7-a7d6-9dd0bad8abe8 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received unexpected event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 for instance with vm_state building and task_state spawning.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance spawned successfully.
Aug 09 20:52:07 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:07 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7605MB free_disk=25.153644561767578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc96c1-48bd-48a4-a1cb-d64a5078377c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjwRvQyC {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjwRvQyC" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d42c9-9a5c-4a51-a31e-bd2669df66ac]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjwRvQyC'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614326.9799533, f6fbe0e3-8e6a-48d4-941a-b7046c225fad => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] VM Started (Lifecycle Event)
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] No waiting events found dispatching network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:07 user nova-compute[72620]: WARNING nova.compute.manager [req-b45db5a3-ef8f-4fa1-86f8-1303ba842286 req-f3719e5c-a10a-499a-9578-58e3ea29e8e4 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received unexpected event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 for instance with vm_state building and task_state spawning.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e48a1-6025-4bb7-ab5c-d30a17a8ca41]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82bbf31-6876-4d8d-9351-e978b2c676a0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Took 7.76 seconds to spawn the instance on the hypervisor.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d806c-bd86-4a30-b51b-901c4936b860]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]
Aug 09 20:52:07 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.
Aug 09 20:52:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[28584fe2-23c4-4a35-82d0-d863d400aaa2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[31461278-cfa6-46f5-9595-7c823a4fb695]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:07 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 3.198s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:52:07 user nova-compute[72620]: INFO nova.compute.manager [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Took 8.74 seconds to build instance.
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8295de0-6159-45b1-891d-b0b48d9672f5]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-bfcbb24d-a32f-4054-bb6b-a2ecacf45f6d tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.900s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f549b053-68a4-415c-890b-85aff113aa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 23220e25-c7e8-4419-b412-555200a63f31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:52:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.966s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.247s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== connect_volume: return (4249ms) {'type': 'block', 'scsi_wwn': '26332633265386266', 'path': '/dev/sdf'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332633265386266', 'path': '/dev/sdf'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974854128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.objects.instance [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'pci_devices' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:52:08 user nova-compute[72620]:   <uuid>23220e25-c7e8-4419-b412-555200a63f31</uuid>
Aug 09 20:52:08 user nova-compute[72620]:   <name>instance-00000016</name>
Aug 09 20:52:08 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:52:08 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:52:08 user nova-compute[72620]:   <metadata>
Aug 09 20:52:08 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:52:08 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:52:08 user nova-compute[72620]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1974854128</nova:name>
Aug 09 20:52:08 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:52:04</nova:creationTime>
Aug 09 20:52:08 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:52:08 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:52:08 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:52:08 user nova-compute[72620]:       <nova:owner>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:user uuid="dff7b04b13c74b37b5173df56d20243d">tempest-ServerActionsV293TestJSON-925057936-project-member</nova:user>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:project uuid="4f8a02e7fda64d4c9b0bde7b090bd821">tempest-ServerActionsV293TestJSON-925057936</nova:project>
Aug 09 20:52:08 user nova-compute[72620]:       </nova:owner>
Aug 09 20:52:08 user nova-compute[72620]:       <nova:ports>
Aug 09 20:52:08 user nova-compute[72620]:         <nova:port uuid="f57f6189-a1dc-4a63-81e8-eb0c376f34a4">
Aug 09 20:52:08 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:52:08 user nova-compute[72620]:         </nova:port>
Aug 09 20:52:08 user nova-compute[72620]:       </nova:ports>
Aug 09 20:52:08 user nova-compute[72620]:     </nova:instance>
Aug 09 20:52:08 user nova-compute[72620]:   </metadata>
Aug 09 20:52:08 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:52:08 user nova-compute[72620]:     <system>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="serial">23220e25-c7e8-4419-b412-555200a63f31</entry>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="uuid">23220e25-c7e8-4419-b412-555200a63f31</entry>
Aug 09 20:52:08 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:52:08 user nova-compute[72620]:     </system>
Aug 09 20:52:08 user nova-compute[72620]:   </sysinfo>
Aug 09 20:52:08 user nova-compute[72620]:   <os>
Aug 09 20:52:08 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:52:08 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:52:08 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:52:08 user nova-compute[72620]:   </os>
Aug 09 20:52:08 user nova-compute[72620]:   <features>
Aug 09 20:52:08 user nova-compute[72620]:     <acpi/>
Aug 09 20:52:08 user nova-compute[72620]:     <apic/>
Aug 09 20:52:08 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:52:08 user nova-compute[72620]:   </features>
Aug 09 20:52:08 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:52:08 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:52:08 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:52:08 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:52:08 user nova-compute[72620]:   </clock>
Aug 09 20:52:08 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:52:08 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:52:08 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:52:08 user nova-compute[72620]:   </cpu>
Aug 09 20:52:08 user nova-compute[72620]:   <devices>
Aug 09 20:52:08 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:52:08 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:08 user nova-compute[72620]:       <source dev="/dev/sdf"/>
Aug 09 20:52:08 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:52:08 user nova-compute[72620]:       <serial>54d88d46-071f-4ae4-9884-61011298d7ee</serial>
Aug 09 20:52:08 user nova-compute[72620]:     </disk>
Aug 09 20:52:08 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:52:08 user nova-compute[72620]:       <mac address="fa:16:3e:3d:56:b5"/>
Aug 09 20:52:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:08 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:52:08 user nova-compute[72620]:       <target dev="tapf57f6189-a1"/>
Aug 09 20:52:08 user nova-compute[72620]:     </interface>
Aug 09 20:52:08 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:52:08 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31/console.log" append="off"/>
Aug 09 20:52:08 user nova-compute[72620]:     </serial>
Aug 09 20:52:08 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:52:08 user nova-compute[72620]:     <video>
Aug 09 20:52:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:08 user nova-compute[72620]:     </video>
Aug 09 20:52:08 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:52:08 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:52:08 user nova-compute[72620]:     </rng>
Aug 09 20:52:08 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:52:08 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:52:08 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:52:08 user nova-compute[72620]:     </memballoon>
Aug 09 20:52:08 user nova-compute[72620]:   </devices>
Aug 09 20:52:08 user nova-compute[72620]: </domain>
Aug 09 20:52:08 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1974854128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG os_vif [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf57f6189-a1, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf57f6189-a1, col_values=(('external_ids', {'iface-id': 'f57f6189-a1dc-4a63-81e8-eb0c376f34a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:56:b5', 'vm-uuid': '23220e25-c7e8-4419-b412-555200a63f31'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: INFO os_vif [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1')
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] No VIF found with MAC fa:16:3e:3d:56:b5, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:08 user nova-compute[72620]: WARNING nova.compute.manager [req-dac803a0-0fe5-44b7-bf60-5868ff5b98f6 req-7decf67b-c537-430e-bafd-bf4a5c05e715 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state rescuing.
Aug 09 20:52:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance destroyed successfully.
Aug 09 20:52:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Attempting rescue
Aug 09 20:52:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:52:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Creating image(s)
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'trusted_certs' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.190s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue" returned: 0 in 0.071s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'migration_context' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start _get_guest_xml network_info=[{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:9f:dd:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'numa_topology' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:10 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'vcpu_model' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-660232359',display_name='tempest-ServerRescueNegativeTestJSON-server-660232359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-660232359',id=21,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABgHK6gyY32EYkTOwN0mKoh3lA+sitobdqJ6ObssRsSY/2F1LPDKENlmEerxZI+ot/4+o3MhM1R2A+ou6Jf2S5wiC8HS0dKBS48TQ3SUqPk/Nya8PRS+8Xhx1LvFI6omw==',key_name='tempest-keypair-1015569012',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-8o0ar9ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fb3d20c3-8fc1-4661-9da8-d83cd6fced50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:9f:dd:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "vif_mac": "fa:16:3e:9f:dd:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'pci_devices' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:52:10 user nova-compute[72620]:   <uuid>fb3d20c3-8fc1-4661-9da8-d83cd6fced50</uuid>
Aug 09 20:52:10 user nova-compute[72620]:   <name>instance-00000015</name>
Aug 09 20:52:10 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:52:10 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:52:10 user nova-compute[72620]:   <metadata>
Aug 09 20:52:10 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:52:10 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-660232359</nova:name>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:52:10</nova:creationTime>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:52:10 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:52:10 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:owner>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:user uuid="a62ad594d1d64a5e9c14551b4d87e6e1">tempest-ServerRescueNegativeTestJSON-1950348124-project-member</nova:user>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:project uuid="017c3a5764804c1ab1c5cde902ed6596">tempest-ServerRescueNegativeTestJSON-1950348124</nova:project>
Aug 09 20:52:10 user nova-compute[72620]:       </nova:owner>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:52:10 user nova-compute[72620]:       <nova:ports>
Aug 09 20:52:10 user nova-compute[72620]:         <nova:port uuid="c9ffb0c1-1a87-4b11-8af8-8e69c996a711">
Aug 09 20:52:10 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 20:52:10 user nova-compute[72620]:         </nova:port>
Aug 09 20:52:10 user nova-compute[72620]:       </nova:ports>
Aug 09 20:52:10 user nova-compute[72620]:     </nova:instance>
Aug 09 20:52:10 user nova-compute[72620]:   </metadata>
Aug 09 20:52:10 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:52:10 user nova-compute[72620]:     <system>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="serial">fb3d20c3-8fc1-4661-9da8-d83cd6fced50</entry>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="uuid">fb3d20c3-8fc1-4661-9da8-d83cd6fced50</entry>
Aug 09 20:52:10 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:52:10 user nova-compute[72620]:     </system>
Aug 09 20:52:10 user nova-compute[72620]:   </sysinfo>
Aug 09 20:52:10 user nova-compute[72620]:   <os>
Aug 09 20:52:10 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:52:10 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:52:10 user nova-compute[72620]:   </os>
Aug 09 20:52:10 user nova-compute[72620]:   <features>
Aug 09 20:52:10 user nova-compute[72620]:     <acpi/>
Aug 09 20:52:10 user nova-compute[72620]:     <apic/>
Aug 09 20:52:10 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:52:10 user nova-compute[72620]:   </features>
Aug 09 20:52:10 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:52:10 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:52:10 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:52:10 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:52:10 user nova-compute[72620]:   </clock>
Aug 09 20:52:10 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:52:10 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:52:10 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:52:10 user nova-compute[72620]:   </cpu>
Aug 09 20:52:10 user nova-compute[72620]:   <devices>
Aug 09 20:52:10 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:52:10 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:52:10 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue"/>
Aug 09 20:52:10 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:52:10 user nova-compute[72620]:     </disk>
Aug 09 20:52:10 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:52:10 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:52:10 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk"/>
Aug 09 20:52:10 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:52:10 user nova-compute[72620]:     </disk>
Aug 09 20:52:10 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:52:10 user nova-compute[72620]:       <mac address="fa:16:3e:9f:dd:ba"/>
Aug 09 20:52:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:10 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:52:10 user nova-compute[72620]:       <target dev="tapc9ffb0c1-1a"/>
Aug 09 20:52:10 user nova-compute[72620]:     </interface>
Aug 09 20:52:10 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:52:10 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/console.log" append="off"/>
Aug 09 20:52:10 user nova-compute[72620]:     </serial>
Aug 09 20:52:10 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:52:10 user nova-compute[72620]:     <video>
Aug 09 20:52:10 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:10 user nova-compute[72620]:     </video>
Aug 09 20:52:10 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:52:10 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:52:10 user nova-compute[72620]:     </rng>
Aug 09 20:52:10 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:52:10 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:52:10 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:52:10 user nova-compute[72620]:     </memballoon>
Aug 09 20:52:10 user nova-compute[72620]:   </devices>
Aug 09 20:52:10 user nova-compute[72620]: </domain>
Aug 09 20:52:10 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:52:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance destroyed successfully.
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] No VIF found with MAC fa:16:3e:9f:dd:ba, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:10 user nova-compute[72620]: WARNING nova.compute.manager [req-5f665d30-bece-4cfd-b2e1-1730afd6d62c req-47f4ba36-732c-41a8-924d-0b2d3060dbab service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state building and task_state spawning.
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:10 user nova-compute[72620]: WARNING nova.compute.manager [req-bb54db7c-1301-461a-baa0-d90d9ad2de43 req-9d08166d-98d2-466e-ab53-00c6a42365a3 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state rescuing.
Aug 09 20:52:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:13 user nova-compute[72620]: WARNING nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state rescuing.
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:13 user nova-compute[72620]: WARNING nova.compute.manager [req-076624b5-a078-4408-bbb3-74665807de39 req-f11c7a6f-777d-4c4f-b6e2-a0d72d761118 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state rescuing.
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:13 user nova-compute[72620]: WARNING nova.compute.manager [req-5c653550-7f55-4c1f-a300-b8b6329dfb6e req-95dc6479-c3b4-44fe-91f6-c26f213f4f17 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state building and task_state spawning.
Aug 09 20:52:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614334.091684, 23220e25-c7e8-4419-b412-555200a63f31 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Resumed (Lifecycle Event)
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance spawned successfully.
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614334.0989544, 23220e25-c7e8-4419-b412-555200a63f31 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Started (Lifecycle Event)
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Took 10.20 seconds to spawn the instance on the hypervisor.
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Took 21.62 seconds to build instance.
Aug 09 20:52:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-189875fd-5c89-4828-806d-c2942c1524f4 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.729s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for fb3d20c3-8fc1-4661-9da8-d83cd6fced50 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614334.8658314, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Resumed (Lifecycle Event)
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-338ca87e-e710-4f51-bc91-d444b128c59a tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614334.8707275, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:14 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Started (Lifecycle Event)
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing instance network info cache due to event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updated VIF entry in instance network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e175fc3e-3227-4218-b2b4-dea2ce1d3bcf req-4dd788d5-b415-429a-b6bc-0ecdf306572d service nova] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:24 user nova-compute[72620]: INFO nova.compute.manager [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Detaching volume 8782adb1-6ea2-40f5-9b83-d4d69e96718a
Aug 09 20:52:24 user nova-compute[72620]: INFO nova.virt.block_device [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Attempting to driver detach volume 8782adb1-6ea2-40f5-9b83-d4d69e96718a from mountpoint /dev/vdb
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Attempting to detach device vdb from instance f549b053-68a4-415c-890b-85aff113aa9f from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:52:24 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:24 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:52:24 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:52:24 user nova-compute[72620]:   <serial>8782adb1-6ea2-40f5-9b83-d4d69e96718a</serial>
Aug 09 20:52:24 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:52:24 user nova-compute[72620]: </disk>
Aug 09 20:52:24 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:52:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully detached device vdb from instance f549b053-68a4-415c-890b-85aff113aa9f from the persistent domain config.
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f549b053-68a4-415c-890b-85aff113aa9f from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:52:24 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:24 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:52:24 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:52:24 user nova-compute[72620]:   <serial>8782adb1-6ea2-40f5-9b83-d4d69e96718a</serial>
Aug 09 20:52:24 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:52:24 user nova-compute[72620]: </disk>
Aug 09 20:52:24 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614344.8275197, f549b053-68a4-415c-890b-85aff113aa9f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:52:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully detached device vdb from instance f549b053-68a4-415c-890b-85aff113aa9f from the live domain config.
Aug 09 20:52:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pGikSUel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:24 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8cee4e-05e9-4f3d-a43b-8cd2a4c5fcea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c715c-150b-4c1b-896c-d167ddae31a4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:24 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305bc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef27a7-af88-4165-a0d2-4e24bbb6e6e1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e3619-38ec-40a9-966f-56d3c1355b38]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:52:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[49473b89-761e-400e-9100-d0e074eb12cd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[823431ea-7237-439e-b2fb-397fe292e2c0]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a095a5e7-a346-41cb-ad11-51ae66b3a454]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing instance network info cache due to event network-changed-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] Acquiring lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] Acquired lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Refreshing network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884e5f3-fd42-40e9-ab62-9c2d1a7f4792]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260]
Aug 09 20:52:25 user nova-compute[72620]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a, portal: 172.16.0.220,3260] successful.
Aug 09 20:52:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8782adb1-6ea2-40f5-9b83-d4d69e96718a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de1a905-453e-412b-8f0a-e882caa821d0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== disconnect_volume: return (365ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updated VIF entry in instance network info cache for port 1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [{"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:25 user nova-compute[72620]: INFO nova.compute.manager [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Detaching volume 224a834a-cc1c-4891-ad45-87a17743e10f
Aug 09 20:52:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91199201-47c3-4c25-a006-f559df15f35f req-d93a697f-7e14-4f83-bccc-d91b4e89b477 service nova] Releasing lock "refresh_cache-f549b053-68a4-415c-890b-85aff113aa9f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:25 user nova-compute[72620]: INFO nova.virt.block_device [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Attempting to driver detach volume 224a834a-cc1c-4891-ad45-87a17743e10f from mountpoint /dev/vdb
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Attempting to detach device vdb from instance c5872c41-5db7-42aa-9145-108eec912a53 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:52:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:25 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:52:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:52:25 user nova-compute[72620]:   <serial>224a834a-cc1c-4891-ad45-87a17743e10f</serial>
Aug 09 20:52:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:52:25 user nova-compute[72620]: </disk>
Aug 09 20:52:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:52:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdb from instance c5872c41-5db7-42aa-9145-108eec912a53 from the persistent domain config.
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5872c41-5db7-42aa-9145-108eec912a53 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:52:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:52:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:25 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:52:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:52:25 user nova-compute[72620]:   <serial>224a834a-cc1c-4891-ad45-87a17743e10f</serial>
Aug 09 20:52:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:52:25 user nova-compute[72620]: </disk>
Aug 09 20:52:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-90c8a534-5fe4-46f0-a14c-fd7ed3bd41dd tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614346.3753767, c5872c41-5db7-42aa-9145-108eec912a53 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:52:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdb from instance c5872c41-5db7-42aa-9145-108eec912a53 from the live domain config.
Aug 09 20:52:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MEBfUXxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b1f12-5ed7-4c42-ac6b-f1cc655d64ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db491d-82ed-4890-a3cb-cbcc5ba412d7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:26 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d208790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f9acb-1a18-476e-b59c-098736f5b62c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae84d3f-22c2-4e9c-93ff-533744344769]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[05149774-b259-4f22-b33d-bc118e1d44f4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e724a-9c68-4e31-b8cd-70a49ff54503]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da94b1-f035-4239-a149-7102d89f7f96]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa27dc7-4222-486e-9b3a-5d8fca917d47]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260]
Aug 09 20:52:26 user nova-compute[72620]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f, portal: 172.16.0.220,3260] successful.
Aug 09 20:52:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:224a834a-cc1c-4891-ad45-87a17743e10f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d54e18-4854-4c0b-9acb-e86d1b73f7d9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== disconnect_volume: return (308ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:52:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:27 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a8f90f5e-7ec1-436c-869a-3b798f42f503 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.772s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72620) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:28 user nova-compute[72620]: WARNING nova.compute.manager [req-b2933b62-2a84-4865-9ddc-dabc9c916d52 req-5a4cd0e5-9c37-43ce-9cc5-b45348754ca0 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state active and task_state powering-off.
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance destroyed successfully.
Aug 09 20:52:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-11fa2a7b-b8b8-43ac-af69-997a541f67d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.995s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:30 user nova-compute[72620]: WARNING nova.compute.manager [req-7f9b3c7f-bcd8-4318-ac87-d07a69c6c4fc req-fb625f9c-ced0-442e-8495-bdfd1ed5ad6c service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state None.
Aug 09 20:52:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:52:32 user nova-compute[72620]: INFO nova.compute.claims [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Claim successful on node user
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.310s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:52:32 user nova-compute[72620]: INFO nova.compute.claims [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Claim successful on node user
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:52:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:52:32 user nova-compute[72620]: INFO nova.virt.block_device [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Booting with volume snapshot ad15014d-cc49-4f99-b36b-0c371299b8e8 at /dev/vda
Aug 09 20:52:32 user nova-compute[72620]: DEBUG nova.policy [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:52:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.policy [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6092876ce064105bf09fcb634e29706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ad9263e8f54164abc4819664613850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:52:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Creating image(s)
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "/opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "/opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "/opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Successfully created port: 496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.171s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk 1073741824" returned: 0 in 0.110s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Successfully created port: 82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Cannot resize image /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'migration_context' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Ensure instance console log exists: /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Successfully updated port: 82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquired lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-changed-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Refreshing instance network info cache due to event network-changed-82f29ab5-f1c5-4236-aea5-452601072106. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] Acquiring lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Successfully updated port: 496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-changed-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Refreshing instance network info cache due to event network-changed-496a2970-55ae-4edc-bbb9-9dc4de5dae08. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] Acquiring lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating instance_info_cache with network_info: [{"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Releasing lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Instance network_info: |[{"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] Acquired lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Refreshing network info cache for port 82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Start _get_guest_xml network_info=[{"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:52:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1753197509',display_name='tempest-VolumesSnapshotTestJSON-instance-1753197509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1753197509',id=25,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEhAOZCFBQHz4eGVuW0rl9lALqv+isydb1ngIW+MHf2djBgrBHZB2axPyGUG28u8OS87TZkc2QPZnkK7L6I7DK3036ChmAuKJG0TXNjANvxAti3iqOEVhRokD+MuYMc8A==',key_name='tempest-keypair-103170811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-h2e2wq4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=09616da6-15dc-4a79-ad1d-19554b86d529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'pci_devices' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:52:35 user nova-compute[72620]:   <uuid>09616da6-15dc-4a79-ad1d-19554b86d529</uuid>
Aug 09 20:52:35 user nova-compute[72620]:   <name>instance-00000019</name>
Aug 09 20:52:35 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:52:35 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:52:35 user nova-compute[72620]:   <metadata>
Aug 09 20:52:35 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:52:35 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1753197509</nova:name>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:52:35</nova:creationTime>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:52:35 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:52:35 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:owner>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:user uuid="d6092876ce064105bf09fcb634e29706">tempest-VolumesSnapshotTestJSON-1826983670-project-member</nova:user>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:project uuid="d8ad9263e8f54164abc4819664613850">tempest-VolumesSnapshotTestJSON-1826983670</nova:project>
Aug 09 20:52:35 user nova-compute[72620]:       </nova:owner>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:52:35 user nova-compute[72620]:       <nova:ports>
Aug 09 20:52:35 user nova-compute[72620]:         <nova:port uuid="82f29ab5-f1c5-4236-aea5-452601072106">
Aug 09 20:52:35 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 09 20:52:35 user nova-compute[72620]:         </nova:port>
Aug 09 20:52:35 user nova-compute[72620]:       </nova:ports>
Aug 09 20:52:35 user nova-compute[72620]:     </nova:instance>
Aug 09 20:52:35 user nova-compute[72620]:   </metadata>
Aug 09 20:52:35 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:52:35 user nova-compute[72620]:     <system>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="serial">09616da6-15dc-4a79-ad1d-19554b86d529</entry>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="uuid">09616da6-15dc-4a79-ad1d-19554b86d529</entry>
Aug 09 20:52:35 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:52:35 user nova-compute[72620]:     </system>
Aug 09 20:52:35 user nova-compute[72620]:   </sysinfo>
Aug 09 20:52:35 user nova-compute[72620]:   <os>
Aug 09 20:52:35 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:52:35 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:52:35 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:52:35 user nova-compute[72620]:   </os>
Aug 09 20:52:35 user nova-compute[72620]:   <features>
Aug 09 20:52:35 user nova-compute[72620]:     <acpi/>
Aug 09 20:52:35 user nova-compute[72620]:     <apic/>
Aug 09 20:52:35 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:52:35 user nova-compute[72620]:   </features>
Aug 09 20:52:35 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:52:35 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:52:35 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:52:35 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:52:35 user nova-compute[72620]:   </clock>
Aug 09 20:52:35 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:52:35 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:52:35 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:52:35 user nova-compute[72620]:   </cpu>
Aug 09 20:52:35 user nova-compute[72620]:   <devices>
Aug 09 20:52:35 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:52:35 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:52:35 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk"/>
Aug 09 20:52:35 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:52:35 user nova-compute[72620]:     </disk>
Aug 09 20:52:35 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:52:35 user nova-compute[72620]:       <mac address="fa:16:3e:28:df:2c"/>
Aug 09 20:52:35 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:35 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:52:35 user nova-compute[72620]:       <target dev="tap82f29ab5-f1"/>
Aug 09 20:52:35 user nova-compute[72620]:     </interface>
Aug 09 20:52:35 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:52:35 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/console.log" append="off"/>
Aug 09 20:52:35 user nova-compute[72620]:     </serial>
Aug 09 20:52:35 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:52:35 user nova-compute[72620]:     <video>
Aug 09 20:52:35 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:35 user nova-compute[72620]:     </video>
Aug 09 20:52:35 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:52:35 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:52:35 user nova-compute[72620]:     </rng>
Aug 09 20:52:35 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:52:35 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:52:35 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:52:35 user nova-compute[72620]:     </memballoon>
Aug 09 20:52:35 user nova-compute[72620]:   </devices>
Aug 09 20:52:35 user nova-compute[72620]: </domain>
Aug 09 20:52:35 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1753197509',display_name='tempest-VolumesSnapshotTestJSON-instance-1753197509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1753197509',id=25,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEhAOZCFBQHz4eGVuW0rl9lALqv+isydb1ngIW+MHf2djBgrBHZB2axPyGUG28u8OS87TZkc2QPZnkK7L6I7DK3036ChmAuKJG0TXNjANvxAti3iqOEVhRokD+MuYMc8A==',key_name='tempest-keypair-103170811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-h2e2wq4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:52:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=09616da6-15dc-4a79-ad1d-19554b86d529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG os_vif [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82f29ab5-f1, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82f29ab5-f1, col_values=(('external_ids', {'iface-id': '82f29ab5-f1c5-4236-aea5-452601072106', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:df:2c', 'vm-uuid': '09616da6-15dc-4a79-ad1d-19554b86d529'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:35 user nova-compute[72620]: INFO os_vif [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1')
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No VIF found with MAC fa:16:3e:28:df:2c, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Updating instance_info_cache with network_info: [{"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Instance network_info: |[{"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] Acquired lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Refreshing network info cache for port 496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updated VIF entry in instance network info cache for port 82f29ab5-f1c5-4236-aea5-452601072106. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG nova.network.neutron [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating instance_info_cache with network_info: [{"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0e89bc44-d202-40b8-8e5e-3fbf70b8c049 req-75b9afa2-1caf-4911-b2e7-a8713b4ec496 service nova] Releasing lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Updated VIF entry in instance network info cache for port 496a2970-55ae-4edc-bbb9-9dc4de5dae08. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Updating instance_info_cache with network_info: [{"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa31d849-3338-42ed-9c70-892688b50f43 req-9b1171f9-c6f7-4244-b160-d4853f34cdc1 service nova] Releasing lock "refresh_cache-b266dec9-5c8c-42c4-8de4-61cbef595c68" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] No waiting events found dispatching network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:37 user nova-compute[72620]: WARNING nova.compute.manager [req-a8a9fb60-47b2-4da1-a68b-341a6982085f req-4c7f4d5b-c188-4be7-bf64-ce1a3eeeee3d service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received unexpected event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 for instance with vm_state building and task_state spawning.
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.utils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed21f9f-0935-4a66-8ba9-7d2371bfce19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e10cbc-de20-4e55-a49f-e2ab0eecb044]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b22420b-d213-43db-9403-29e8a1ae19e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21352c9-87ee-4e65-9ace-88da7f489727]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:52:38 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:52:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6e9fef-ced7-4c83-97a3-a6afc9ac6c91]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG os_brick.utils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:38 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Updating existing volume attachment record: e7b35776-1577-47bc-b409-fdbf4192f643 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614359.044152, 09616da6-15dc-4a79-ad1d-19554b86d529 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] VM Resumed (Lifecycle Event)
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Instance spawned successfully.
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614359.0459347, 09616da6-15dc-4a79-ad1d-19554b86d529 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] VM Started (Lifecycle Event)
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] No waiting events found dispatching network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:39 user nova-compute[72620]: WARNING nova.compute.manager [req-7653116b-4895-427b-bda0-52ad39d9bd2d req-92c2c1af-9d96-4870-b574-f6e92bc5b18a service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received unexpected event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 for instance with vm_state building and task_state spawning.
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 09 20:52:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:39 user nova-compute[72620]: INFO nova.compute.manager [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Took 6.81 seconds to build instance.
Aug 09 20:52:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-983996a7-7729-4cd2-b3c1-8ff3480440bf tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:44 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614349.0324984, c5872c41-5db7-42aa-9145-108eec912a53 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:44 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Stopped (Lifecycle Event)
Aug 09 20:52:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3fc25f49-15e4-4306-a1be-a9f4e2133813 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3fc25f49-15e4-4306-a1be-a9f4e2133813 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:52:48 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Creating image(s)
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Ensure instance console log exists: /opt/stack/data/nova/instances/b266dec9-5c8c-42c4-8de4-61cbef595c68/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Start _get_guest_xml network_info=[{"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjgoBCYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b266dec9-5c8c-42c4-8de4-61cbef595c68', 'attached_at': '', 'detached_at': '', 'volume_id': 'e1979ce3-8f31-436b-969c-86bbc7c84143', 'serial': 'e1979ce3-8f31-436b-969c-86bbc7c84143'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'e7b35776-1577-47bc-b409-fdbf4192f643', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:52:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:48 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjgoBCYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:52:48 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:48 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:52:48 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd6a9f-6029-499f-b95f-c2664de980aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:52:48 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[648bc178-2586-4417-afe7-c8d6cdf443a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143] added
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f55669-376d-42ed-92e4-9b5d8ac3b0bc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7387544d-0b23-49cb-a69c-21ba7ccf696b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjgoBCYv {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjgoBCYv" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8601741-02bf-4d5d-bb53-d11abb501a12]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UjgoBCYv'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf177178-fd2c-4d55-b785-f058fb7928d4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c638f6-8ddf-4037-afc6-bb0b38e6be90]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc344c2-044b-4860-b908-993bf2b9b14f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260]
Aug 09 20:52:48 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260] successful.
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a44f62-e55d-4e63-8ff9-ad3f96794b6b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a54921-d74f-4057-b070-3e890c8a2967]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:52:48 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:52:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735f65e-6854-4dbf-b7d1-616f3c357f8e]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:52:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjgoBCYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26638613465386162', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638613465386162', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-120184176',display_name='tempest-TestVolumeBootPattern-server-120184176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-120184176',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-wy4fs744',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:52:33Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=b266dec9-5c8c-42c4-8de4-61cbef595c68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid b266dec9-5c8c-42c4-8de4-61cbef595c68 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:52:49 user nova-compute[72620]:   <uuid>b266dec9-5c8c-42c4-8de4-61cbef595c68</uuid>
Aug 09 20:52:49 user nova-compute[72620]:   <name>instance-00000018</name>
Aug 09 20:52:49 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:52:49 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:52:49 user nova-compute[72620]:   <metadata>
Aug 09 20:52:49 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:52:49 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:52:49 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-server-120184176</nova:name>
Aug 09 20:52:49 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:52:48</nova:creationTime>
Aug 09 20:52:49 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:52:49 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:52:49 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:52:49 user nova-compute[72620]:       <nova:owner>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 20:52:49 user nova-compute[72620]:       </nova:owner>
Aug 09 20:52:49 user nova-compute[72620]:       <nova:ports>
Aug 09 20:52:49 user nova-compute[72620]:         <nova:port uuid="496a2970-55ae-4edc-bbb9-9dc4de5dae08">
Aug 09 20:52:49 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 20:52:49 user nova-compute[72620]:         </nova:port>
Aug 09 20:52:49 user nova-compute[72620]:       </nova:ports>
Aug 09 20:52:49 user nova-compute[72620]:     </nova:instance>
Aug 09 20:52:49 user nova-compute[72620]:   </metadata>
Aug 09 20:52:49 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:52:49 user nova-compute[72620]:     <system>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="serial">b266dec9-5c8c-42c4-8de4-61cbef595c68</entry>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="uuid">b266dec9-5c8c-42c4-8de4-61cbef595c68</entry>
Aug 09 20:52:49 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:52:49 user nova-compute[72620]:     </system>
Aug 09 20:52:49 user nova-compute[72620]:   </sysinfo>
Aug 09 20:52:49 user nova-compute[72620]:   <os>
Aug 09 20:52:49 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:52:49 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:52:49 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:52:49 user nova-compute[72620]:   </os>
Aug 09 20:52:49 user nova-compute[72620]:   <features>
Aug 09 20:52:49 user nova-compute[72620]:     <acpi/>
Aug 09 20:52:49 user nova-compute[72620]:     <apic/>
Aug 09 20:52:49 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:52:49 user nova-compute[72620]:   </features>
Aug 09 20:52:49 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:52:49 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:52:49 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:52:49 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:52:49 user nova-compute[72620]:   </clock>
Aug 09 20:52:49 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:52:49 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:52:49 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:52:49 user nova-compute[72620]:   </cpu>
Aug 09 20:52:49 user nova-compute[72620]:   <devices>
Aug 09 20:52:49 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:52:49 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:52:49 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:52:49 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:52:49 user nova-compute[72620]:       <serial>e1979ce3-8f31-436b-969c-86bbc7c84143</serial>
Aug 09 20:52:49 user nova-compute[72620]:     </disk>
Aug 09 20:52:49 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:52:49 user nova-compute[72620]:       <mac address="fa:16:3e:32:7c:6f"/>
Aug 09 20:52:49 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:49 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:52:49 user nova-compute[72620]:       <target dev="tap496a2970-55"/>
Aug 09 20:52:49 user nova-compute[72620]:     </interface>
Aug 09 20:52:49 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:52:49 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/b266dec9-5c8c-42c4-8de4-61cbef595c68/console.log" append="off"/>
Aug 09 20:52:49 user nova-compute[72620]:     </serial>
Aug 09 20:52:49 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:52:49 user nova-compute[72620]:     <video>
Aug 09 20:52:49 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:52:49 user nova-compute[72620]:     </video>
Aug 09 20:52:49 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:52:49 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:52:49 user nova-compute[72620]:     </rng>
Aug 09 20:52:49 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:52:49 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:52:49 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:52:49 user nova-compute[72620]:     </memballoon>
Aug 09 20:52:49 user nova-compute[72620]:   </devices>
Aug 09 20:52:49 user nova-compute[72620]: </domain>
Aug 09 20:52:49 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-120184176',display_name='tempest-TestVolumeBootPattern-server-120184176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-120184176',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-wy4fs744',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:52:33Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=b266dec9-5c8c-42c4-8de4-61cbef595c68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG os_vif [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap496a2970-55, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap496a2970-55, col_values=(('external_ids', {'iface-id': '496a2970-55ae-4edc-bbb9-9dc4de5dae08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:7c:6f', 'vm-uuid': 'b266dec9-5c8c-42c4-8de4-61cbef595c68'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:49 user nova-compute[72620]: INFO os_vif [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55')
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:52:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:32:7c:6f, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:52:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] No waiting events found dispatching network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:51 user nova-compute[72620]: WARNING nova.compute.manager [req-fbffdea4-f66b-4cae-811a-493579f5c099 req-5271ca22-80ff-49b0-9d25-9bd04f407af9 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received unexpected event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 for instance with vm_state building and task_state spawning.
Aug 09 20:52:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:52:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] No waiting events found dispatching network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:52:53 user nova-compute[72620]: WARNING nova.compute.manager [req-975fca0e-7a34-487f-81e6-21e8fac94fb1 req-7f4a2d2f-4230-4bb0-a949-60834155df37 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received unexpected event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 for instance with vm_state building and task_state spawning.
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614373.437605, b266dec9-5c8c-42c4-8de4-61cbef595c68 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] VM Resumed (Lifecycle Event)
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Instance spawned successfully.
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614373.4408169, b266dec9-5c8c-42c4-8de4-61cbef595c68 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] VM Started (Lifecycle Event)
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 09 20:52:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:52:53 user nova-compute[72620]: INFO nova.compute.manager [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Took 21.27 seconds to build instance.
Aug 09 20:52:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-10a6e1e9-eb88-4c94-8578-a75ab096bece tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.358s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:52:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:52:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:52:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:53:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:53:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:53:04 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7003MB free_disk=25.112380981445312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f549b053-68a4-415c-890b-85aff113aa9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 23220e25-c7e8-4419-b412-555200a63f31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance b266dec9-5c8c-42c4-8de4-61cbef595c68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 09616da6-15dc-4a79-ad1d-19554b86d529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:53:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG nova.objects.instance [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'flavor' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.625s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:05 user nova-compute[72620]: INFO nova.compute.manager [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attaching volume f3519a13-8feb-4ee9-95af-7a3e5c09853b to /dev/vdb
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.utils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389e173-6431-4f84-ad9e-8ef8b03b02fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae662b13-846b-4f19-b338-eee5a9c9b44c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45e6a95-570f-4a63-bfb7-59cf26c2c177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9435e099-dae2-4e0f-a71d-d290fc50879b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:05 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:53:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7f9150-0bcf-4da5-a013-608bf21d77be]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG os_brick.utils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:05 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating existing volume attachment record: fe75b226-d721-4b38-8ee4-8a4f48cd4c13 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:53:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:14 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:14 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:14 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f951d-9231-4330-a9f8-537a4cb1d65b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:53:14 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43b1cb-f706-4ac1-8261-25a1578096cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b] added
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e5c0a1-9437-42cb-ab49-28dc71edd208]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7cbeb6-cbe1-4c55-bae6-81306f378a11]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NszPJWgE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NszPJWgE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be922459-f3e5-4436-98fe-7b262f8deb40]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NszPJWgE'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f0d5fa-ccff-4e67-a1fa-c374a6efbd0e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d637673-4cb0-4611-8904-9d8bd5b9a4c4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacf5702-2d30-4dca-a1c9-15198d466a94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]
Aug 09 20:53:14 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca8e4a-5ef4-45bb-afda-3cda134e97ef]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc7a5b-3b25-4d5d-906e-640bc51217d6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:14 user nova-compute[72620]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[417a7a61-687b-42b8-b752-3b2bd0e895e7]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:53:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23865356430313962', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865356430313962', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.objects.instance [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'flavor' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:53:15 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:53:15 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:53:15 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:53:15 user nova-compute[72620]:   <serial>f3519a13-8feb-4ee9-95af-7a3e5c09853b</serial>
Aug 09 20:53:15 user nova-compute[72620]: </disk>
Aug 09 20:53:15 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:53:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No VIF found with MAC fa:16:3e:55:3f:3f, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:53:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-07be0500-15c2-4b9d-90fe-828df80858a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.662s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:17 user nova-compute[72620]: INFO nova.compute.manager [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Rebuilding instance
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_requests' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_devices' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'resources' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'migration_context' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72620) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:18 user nova-compute[72620]: WARNING nova.compute.manager [req-658b3408-12de-4dce-85fc-9910e5a1a9a2 req-5d60f585-6483-4eb7-af63-84c3a0c56e4f service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state active and task_state rebuilding.
Aug 09 20:53:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance destroyed successfully.
Aug 09 20:53:18 user nova-compute[72620]: INFO nova.compute.manager [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Detaching volume f3519a13-8feb-4ee9-95af-7a3e5c09853b
Aug 09 20:53:18 user nova-compute[72620]: INFO nova.virt.block_device [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attempting to driver detach volume f3519a13-8feb-4ee9-95af-7a3e5c09853b from mountpoint /dev/vdb
Aug 09 20:53:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Attempting to detach device vdb from instance bc81ba81-361a-4913-8aab-94e1849f992c from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:53:18 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:53:18 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:53:18 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:53:18 user nova-compute[72620]:   <serial>f3519a13-8feb-4ee9-95af-7a3e5c09853b</serial>
Aug 09 20:53:18 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:53:18 user nova-compute[72620]: </disk>
Aug 09 20:53:18 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:53:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully detached device vdb from instance bc81ba81-361a-4913-8aab-94e1849f992c from the persistent domain config.
Aug 09 20:53:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:53:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[848ebe97-d726-4d7e-8d04-f7d02ff3c236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40338d7a-d1d3-4ae3-aab8-2539b5de27c3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:19 user nova-compute[72620]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305cb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1468d100-8756-4479-bb88-e007390d477e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[85631490-edee-46e7-89dc-e63b0186c33b]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd9c94-d7dc-4e42-a022-1d93808d5985]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb66b5cc-fc85-4e1b-ab80-62b82138068a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a59c2-47ca-44b5-870e-7939dd8045b7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb586c-3ee9-4935-872e-298e2ef23305]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]
Aug 09 20:53:19 user nova-compute[72620]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.
Aug 09 20:53:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0343f1c-9650-4d3c-be9c-d831be7f7628]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== disconnect_volume: return (276ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:53:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance destroyed successfully.
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1867424062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0204bf3f-57, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.compute.manager [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Terminating instance
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: INFO os_vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57')
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8053e5d4-baf4-4ebe-81c6-a732ee362c77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480e553-8f29-4716-bf11-5f7459ae2ac6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:20 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c506ae830>, {}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Disconnecting from: [] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== disconnect_volume: return (66ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Deleting instance files /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c_del
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Deletion of /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c_del complete
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.block_device [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Booting with volume f3519a13-8feb-4ee9-95af-7a3e5c09853b at /dev/vdb
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:20 user nova-compute[72620]: WARNING nova.compute.manager [req-6af01d2f-073c-4079-bfac-d88075019d3c req-d80ce060-6bce-4c2a-9988-da2013444454 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.utils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bce7a2-4c44-4aa5-ad4c-1e2891144a89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2da880-5d84-44ee-8e8f-2a601083357d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[571bbd0f-73f7-4ecd-befa-a468c1da07df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdfef10-3d73-4aa4-b17e-3fa096a7e853]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:20 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:53:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1af949a-9819-4884-9578-82d8e03c1f3a]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_brick.utils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating existing volume attachment record: aafbc239-58c5-4ed1-bede-748525e27b92 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Instance destroyed successfully.
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'resources' on Instance uuid f549b053-68a4-415c-890b-85aff113aa9f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-808070253',display_name='tempest-TestMinimumBasicScenario-server-808070253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-808070253',id=18,image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO6eOPooPRK0jl+W79mpFhRvbaDKwbsA/mm2HyZu2e07a/ne9hO2WjiSr54OKLucA3/qTyL5Kz2IGQckM6aIfxV4MRTtMd/EydCsW4DCQllCKbMrNn/X2od9j4LEYsLUw==',key_name='tempest-TestMinimumBasicScenario-1673740542',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-pl56p0a7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a99b13de-9dd8-4a36-b85e-3842cbb50df7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:50:39Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=f549b053-68a4-415c-890b-85aff113aa9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "address": "fa:16:3e:22:d0:38", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a07b8e0-cf", "ovs_interfaceid": "1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG os_vif [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a07b8e0-cf, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:53:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:20 user nova-compute[72620]: INFO os_vif [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:d0:38,bridge_name='br-int',has_traffic_filtering=True,id=1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a07b8e0-cf')
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Deleting instance files /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f_del
Aug 09 20:53:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Deletion of /opt/stack/data/nova/instances/f549b053-68a4-415c-890b-85aff113aa9f_del complete
Aug 09 20:53:21 user nova-compute[72620]: INFO nova.compute.manager [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:53:21 user nova-compute[72620]: INFO nova.compute.claims [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Claim successful on node user
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:21 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Took 0.61 seconds to deallocate network for instance.
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:53:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.170s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:53:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:53:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.policy [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f794b9e72d4443e86ada7b257af84a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f5de1122514369a2b3f71ae1146194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:53:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Creating image(s)
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:22 user nova-compute[72620]: WARNING nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-unplugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state deleted and task_state None.
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Acquiring lock "f549b053-68a4-415c-890b-85aff113aa9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] Lock "f549b053-68a4-415c-890b-85aff113aa9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] No waiting events found dispatching network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:22 user nova-compute[72620]: WARNING nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received unexpected event network-vif-plugged-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f for instance with vm_state deleted and task_state None.
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8d5c71b-c7b8-4b63-bea4-babfec54e635 req-35a8ebcb-53de-4b7e-a0b8-3e8eded723d5 service nova] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Received event network-vif-deleted-1a07b8e0-cf56-4bed-9d4b-e5a3bbf34e3f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.164s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.711s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk 1073741824" returned: 0 in 0.065s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:22 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Deleted allocations for instance f549b053-68a4-415c-890b-85aff113aa9f
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79fd97b4-e1ce-405e-82ee-1754925278ce tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "f549b053-68a4-415c-890b-85aff113aa9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.624s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Cannot resize image /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'migration_context' on Instance uuid 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Successfully created port: 2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Ensure instance console log exists: /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Successfully updated port: 2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:53:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:53:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updating instance_info_cache with network_info: [{"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Instance network_info: |[{"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Start _get_guest_xml network_info=[{"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:53:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:53:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1550160067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1550160067',id=26,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-yhx5dtxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:22Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=2ba125ef-76c1-44b7-a08c-bdbd7e378f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:53:24 user nova-compute[72620]:   <uuid>2ba125ef-76c1-44b7-a08c-bdbd7e378f90</uuid>
Aug 09 20:53:24 user nova-compute[72620]:   <name>instance-0000001a</name>
Aug 09 20:53:24 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:53:24 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:53:24 user nova-compute[72620]:   <metadata>
Aug 09 20:53:24 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:53:24 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1550160067</nova:name>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:53:24</nova:creationTime>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:53:24 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:53:24 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:owner>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:53:24 user nova-compute[72620]:       </nova:owner>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:53:24 user nova-compute[72620]:       <nova:ports>
Aug 09 20:53:24 user nova-compute[72620]:         <nova:port uuid="2d68f10e-0895-468b-9cf8-ba0a32de4b1d">
Aug 09 20:53:24 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 20:53:24 user nova-compute[72620]:         </nova:port>
Aug 09 20:53:24 user nova-compute[72620]:       </nova:ports>
Aug 09 20:53:24 user nova-compute[72620]:     </nova:instance>
Aug 09 20:53:24 user nova-compute[72620]:   </metadata>
Aug 09 20:53:24 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:53:24 user nova-compute[72620]:     <system>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="serial">2ba125ef-76c1-44b7-a08c-bdbd7e378f90</entry>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="uuid">2ba125ef-76c1-44b7-a08c-bdbd7e378f90</entry>
Aug 09 20:53:24 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:53:24 user nova-compute[72620]:     </system>
Aug 09 20:53:24 user nova-compute[72620]:   </sysinfo>
Aug 09 20:53:24 user nova-compute[72620]:   <os>
Aug 09 20:53:24 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:53:24 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:53:24 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:53:24 user nova-compute[72620]:   </os>
Aug 09 20:53:24 user nova-compute[72620]:   <features>
Aug 09 20:53:24 user nova-compute[72620]:     <acpi/>
Aug 09 20:53:24 user nova-compute[72620]:     <apic/>
Aug 09 20:53:24 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:53:24 user nova-compute[72620]:   </features>
Aug 09 20:53:24 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:53:24 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:53:24 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:53:24 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:53:24 user nova-compute[72620]:   </clock>
Aug 09 20:53:24 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:53:24 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:53:24 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:53:24 user nova-compute[72620]:   </cpu>
Aug 09 20:53:24 user nova-compute[72620]:   <devices>
Aug 09 20:53:24 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:53:24 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:53:24 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk"/>
Aug 09 20:53:24 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:53:24 user nova-compute[72620]:     </disk>
Aug 09 20:53:24 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:53:24 user nova-compute[72620]:       <mac address="fa:16:3e:ac:9f:c7"/>
Aug 09 20:53:24 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:53:24 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:53:24 user nova-compute[72620]:       <target dev="tap2d68f10e-08"/>
Aug 09 20:53:24 user nova-compute[72620]:     </interface>
Aug 09 20:53:24 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:53:24 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/console.log" append="off"/>
Aug 09 20:53:24 user nova-compute[72620]:     </serial>
Aug 09 20:53:24 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:53:24 user nova-compute[72620]:     <video>
Aug 09 20:53:24 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:53:24 user nova-compute[72620]:     </video>
Aug 09 20:53:24 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:53:24 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:53:24 user nova-compute[72620]:     </rng>
Aug 09 20:53:24 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:53:24 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:53:24 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:53:24 user nova-compute[72620]:     </memballoon>
Aug 09 20:53:24 user nova-compute[72620]:   </devices>
Aug 09 20:53:24 user nova-compute[72620]: </domain>
Aug 09 20:53:24 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1550160067',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1550160067',id=26,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-yhx5dtxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:22Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=2ba125ef-76c1-44b7-a08c-bdbd7e378f90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG os_vif [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d68f10e-08, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d68f10e-08, col_values=(('external_ids', {'iface-id': '2d68f10e-0895-468b-9cf8-ba0a32de4b1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9f:c7', 'vm-uuid': '2ba125ef-76c1-44b7-a08c-bdbd7e378f90'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:24 user nova-compute[72620]: INFO os_vif [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08')
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:ac:9f:c7, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-changed-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Refreshing instance network info cache due to event network-changed-2d68f10e-0895-468b-9cf8-ba0a32de4b1d. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] Acquiring lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] Acquired lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Refreshing network info cache for port 2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updated VIF entry in instance network info cache for port 2d68f10e-0895-468b-9cf8-ba0a32de4b1d. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:53:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updating instance_info_cache with network_info: [{"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e798ad80-38aa-4ae6-8d50-9d76ae8eb8f0 req-7952de39-986d-4639-8828-7ee06375ceee service nova] Releasing lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] No waiting events found dispatching network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:26 user nova-compute[72620]: WARNING nova.compute.manager [req-213ef456-f9d5-4f48-b091-41b8eb6f2a25 req-d9675be7-fa7e-493a-be51-c5d7e0b26512 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received unexpected event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d for instance with vm_state building and task_state spawning.
Aug 09 20:53:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614407.8672466, 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] VM Resumed (Lifecycle Event)
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Instance spawned successfully.
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614407.8713183, 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] VM Started (Lifecycle Event)
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 09 20:53:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:53:28 user nova-compute[72620]: INFO nova.compute.manager [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Took 6.78 seconds to build instance.
Aug 09 20:53:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3f714e6d-3f5c-4a16-aa6a-9c35a4b4339c tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.880s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] No waiting events found dispatching network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:28 user nova-compute[72620]: WARNING nova.compute.manager [req-c3589ef9-b24a-4581-82a2-9a9cdbbba3d3 req-5321e79f-be7f-41e8-ae0e-bafb5317d55d service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received unexpected event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d for instance with vm_state active and task_state None.
Aug 09 20:53:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:53:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Creating image(s)
Aug 09 20:53:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk 1073741824" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Cannot resize image /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Ensure instance console log exists: /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start _get_guest_xml network_info=[{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc81ba81-361a-4913-8aab-94e1849f992c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3519a13-8feb-4ee9-95af-7a3e5c09853b', 'serial': 'f3519a13-8feb-4ee9-95af-7a3e5c09853b'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'aafbc239-58c5-4ed1-bede-748525e27b92', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:53:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 20:53:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:30 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:30 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:30 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[56edc417-b353-4d7f-8212-ea37db97777b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:53:30 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[62676994-061a-44dc-9715-de794fa8f93a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b] added
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b86a6b-a867-44d8-a424-2291c753d77b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c6fd0-d5f6-450f-901d-5bf7a650f6aa]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NszPJWgE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NszPJWgE" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6673f7-d026-49e3-bc5e-5b63e60e5b2e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NszPJWgE'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c95ad35-0f60-4e5b-9207-d27c147dfcfd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[736cd5fd-aead-486a-9440-c1954746535c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2230cc-815b-4db2-b476-d19acfee024c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]
Aug 09 20:53:30 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178ee5f-f63b-4304-9aa4-4fb21a3c92c7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb6c6e-7536-4b4d-a1cc-950f9f6afa8a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:30 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de1a17b-43c5-4565-923d-5a9f43afb011]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:53:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:53:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:53:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23865356430313962', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865356430313962', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1867424062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:53:32 user nova-compute[72620]:   <uuid>bc81ba81-361a-4913-8aab-94e1849f992c</uuid>
Aug 09 20:53:32 user nova-compute[72620]:   <name>instance-00000014</name>
Aug 09 20:53:32 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:53:32 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:53:32 user nova-compute[72620]:   <metadata>
Aug 09 20:53:32 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:53:32 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherA-server-1867424062</nova:name>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:53:30</nova:creationTime>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:53:32 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:53:32 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:owner>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:user uuid="1546466d62a6410c83fa85f1b0c8b934">tempest-ServerActionsTestOtherA-763482691-project-member</nova:user>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:project uuid="80ded0dc696e4bd6b25a57202b956d63">tempest-ServerActionsTestOtherA-763482691</nova:project>
Aug 09 20:53:32 user nova-compute[72620]:       </nova:owner>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:53:32 user nova-compute[72620]:       <nova:ports>
Aug 09 20:53:32 user nova-compute[72620]:         <nova:port uuid="0204bf3f-57ea-46ae-a128-69fb487866ff">
Aug 09 20:53:32 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:53:32 user nova-compute[72620]:         </nova:port>
Aug 09 20:53:32 user nova-compute[72620]:       </nova:ports>
Aug 09 20:53:32 user nova-compute[72620]:     </nova:instance>
Aug 09 20:53:32 user nova-compute[72620]:   </metadata>
Aug 09 20:53:32 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:53:32 user nova-compute[72620]:     <system>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="serial">bc81ba81-361a-4913-8aab-94e1849f992c</entry>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="uuid">bc81ba81-361a-4913-8aab-94e1849f992c</entry>
Aug 09 20:53:32 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:53:32 user nova-compute[72620]:     </system>
Aug 09 20:53:32 user nova-compute[72620]:   </sysinfo>
Aug 09 20:53:32 user nova-compute[72620]:   <os>
Aug 09 20:53:32 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:53:32 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:53:32 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:53:32 user nova-compute[72620]:   </os>
Aug 09 20:53:32 user nova-compute[72620]:   <features>
Aug 09 20:53:32 user nova-compute[72620]:     <acpi/>
Aug 09 20:53:32 user nova-compute[72620]:     <apic/>
Aug 09 20:53:32 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:53:32 user nova-compute[72620]:   </features>
Aug 09 20:53:32 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:53:32 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:53:32 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:53:32 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:53:32 user nova-compute[72620]:   </clock>
Aug 09 20:53:32 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:53:32 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:53:32 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:53:32 user nova-compute[72620]:   </cpu>
Aug 09 20:53:32 user nova-compute[72620]:   <devices>
Aug 09 20:53:32 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:53:32 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:53:32 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk"/>
Aug 09 20:53:32 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:53:32 user nova-compute[72620]:     </disk>
Aug 09 20:53:32 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:53:32 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:53:32 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 20:53:32 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:53:32 user nova-compute[72620]:       <serial>f3519a13-8feb-4ee9-95af-7a3e5c09853b</serial>
Aug 09 20:53:32 user nova-compute[72620]:     </disk>
Aug 09 20:53:32 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:53:32 user nova-compute[72620]:       <mac address="fa:16:3e:55:3f:3f"/>
Aug 09 20:53:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:53:32 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:53:32 user nova-compute[72620]:       <target dev="tap0204bf3f-57"/>
Aug 09 20:53:32 user nova-compute[72620]:     </interface>
Aug 09 20:53:32 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:53:32 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/console.log" append="off"/>
Aug 09 20:53:32 user nova-compute[72620]:     </serial>
Aug 09 20:53:32 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:53:32 user nova-compute[72620]:     <video>
Aug 09 20:53:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:53:32 user nova-compute[72620]:     </video>
Aug 09 20:53:32 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:53:32 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:53:32 user nova-compute[72620]:     </rng>
Aug 09 20:53:32 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:53:32 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:53:32 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:53:32 user nova-compute[72620]:     </memballoon>
Aug 09 20:53:32 user nova-compute[72620]:   </devices>
Aug 09 20:53:32 user nova-compute[72620]: </domain>
Aug 09 20:53:32 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1867424062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG os_vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0204bf3f-57, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0204bf3f-57, col_values=(('external_ids', {'iface-id': '0204bf3f-57ea-46ae-a128-69fb487866ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:3f:3f', 'vm-uuid': 'bc81ba81-361a-4913-8aab-94e1849f992c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:32 user nova-compute[72620]: INFO os_vif [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57')
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:53:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No VIF found with MAC fa:16:3e:55:3f:3f, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:33 user nova-compute[72620]: WARNING nova.compute.manager [req-49a15bde-1809-4936-ab2e-993af670e29f req-042449bd-5838-479b-9c33-a9d50c0201c1 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state active and task_state rebuild_spawning.
Aug 09 20:53:33 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614398.7713122, bc81ba81-361a-4913-8aab-94e1849f992c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:33 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Stopped (Lifecycle Event)
Aug 09 20:53:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ec5e947e-8c5f-488c-8c60-a2ba2aae83ab None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614415.678429, bc81ba81-361a-4913-8aab-94e1849f992c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Resumed (Lifecycle Event)
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance spawned successfully.
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614415.682311, bc81ba81-361a-4913-8aab-94e1849f992c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Started (Lifecycle Event)
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:35 user nova-compute[72620]: WARNING nova.compute.manager [req-c78b763b-6473-42c5-9e6c-d4b0d3cc842e req-395f7c46-b2ef-481b-82d7-21f9cb6b5ebd service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state active and task_state rebuild_spawning.
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614400.8812807, f549b053-68a4-415c-890b-85aff113aa9f => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:53:35 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f549b053-68a4-415c-890b-85aff113aa9f] VM Stopped (Lifecycle Event)
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72620) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-57d38422-9cee-40a5-9530-0396111dcb23 None None] [instance: f549b053-68a4-415c-890b-85aff113aa9f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-00eabccf-2cea-4095-a033-5ced83809080 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-changed-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Refreshing instance network info cache due to event network-changed-f57f6189-a1dc-4a63-81e8-eb0c376f34a4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:53:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] Acquiring lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] Acquired lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:43 user nova-compute[72620]: DEBUG nova.network.neutron [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Refreshing network info cache for port f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:53:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updated VIF entry in instance network info cache for port f57f6189-a1dc-4a63-81e8-eb0c376f34a4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:53:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating instance_info_cache with network_info: [{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0eafaecf-ffd6-4e2c-8b27-9e82da0c262b req-325e73ad-d98f-4e8e-b2e0-4ebdfe4be825 service nova] Releasing lock "refresh_cache-23220e25-c7e8-4419-b412-555200a63f31" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:45 user nova-compute[72620]: INFO nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Rebuilding instance
Aug 09 20:53:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'pci_requests' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'pci_devices' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'resources' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'migration_context' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72620) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:46 user nova-compute[72620]: WARNING nova.compute.manager [req-e14029e5-4371-48a2-9c9a-60ed75f222bd req-65ab261c-a15a-426b-8b7b-fbc1376bf807 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state active and task_state rebuilding.
Aug 09 20:53:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance destroyed successfully.
Aug 09 20:53:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance destroyed successfully.
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2016797239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:53:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf57f6189-a1, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:46 user nova-compute[72620]: INFO os_vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1')
Aug 09 20:53:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a715d6f-a6d3-4171-87a5-5df6200a1793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[507073c9-724a-4e54-9c33-18641b694950]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:46 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c304d20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'): ({'sdf'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Removing single pathed devices sdf {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:53:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6526491-a8bb-4230-ba1c-13d899447986]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee9dafd-91d7-4978-81bb-c82e42f83bd9]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flushing IO for device /dev/sdf {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bd31d9-8b36-4801-90a4-07907e321200]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7496c3-b4fa-433b-9a8b-54a0a95939c6]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26332633265386266', '/dev/disk/by-id/scsi-1SCST_BIOb46adf28-c2c2e8bfc408096b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b46adf28') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4364e1-d1a2-4442-a5a1-e6c41715605a]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc6aaf-4fd7-42bf-a352-d5ee0e2ccda5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d33cc-cb3b-4df0-a8ed-515dbf87846a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]
Aug 09 20:53:47 user nova-compute[72620]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.
Aug 09 20:53:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ced9fe-a4c6-4d16-ba40-f9d0116dd142]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== disconnect_volume: return (309ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:53:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deleting instance files /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31_del
Aug 09 20:53:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deletion of /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31_del complete
Aug 09 20:53:47 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 23220e25-c7e8-4419-b412-555200a63f31 could not be found.
Aug 09 20:53:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:47 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a9194-dfd0-4432-8976-97865e929cce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130236d-3152-47d8-b42d-b9c40507bd08]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:53:47 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:53:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c506ad240>, {}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Disconnecting from: [] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== disconnect_volume: return (57ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Preparing to wait for external event volume-reimaged-54d88d46-071f-4ae4-9884-61011298d7ee {{(pid=72620) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No event matching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 in dict_keys([('volume-reimaged', '54d88d46-071f-4ae4-9884-61011298d7ee')]) {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 09 20:53:48 user nova-compute[72620]: WARNING nova.compute.manager [req-4e902934-ccd7-48ab-9e83-055617aee64f req-6317d711-d8bc-4e78-83e3-268a5725e6de service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state active and task_state rebuilding.
Aug 09 20:53:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing instance network info cache due to event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:53:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] Acquiring lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] Acquired lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing network info cache for port a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updated VIF entry in instance network info cache for port a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG nova.network.neutron [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating instance_info_cache with network_info: [{"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-51d0ce8e-056a-42e3-9be9-a45badd7d217 req-10366205-2c98-4aef-afb0-3d523507f666 service nova] Releasing lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG nova.objects.instance [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:51 user nova-compute[72620]: INFO nova.compute.manager [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Attaching volume c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 to /dev/vdb
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.utils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48509c-d2c2-4800-860e-e650e1dae268]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3905f2b1-a905-4ef7-874b-995150596bf1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[647968b5-bba6-4429-9b27-68c69dec0fd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[776aa50b-fa53-481d-81ff-de72a10b5fb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:53:51 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:53:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c169d631-bb88-45f1-867d-2d9d4bff8425]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG os_brick.utils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating existing volume attachment record: 4cc2eaf9-12d6-4756-8807-422c1c6ca95a {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:53:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:53:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:55 user nova-compute[72620]: INFO nova.compute.manager [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Unrescuing
Aug 09 20:53:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:53:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG nova.network.neutron [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG nova.objects.instance [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'flavor' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:56 user nova-compute[72620]: WARNING nova.compute.manager [req-a4bbb053-598d-4fa2-9087-c53d73311ab1 req-6c65fa73-b22a-456e-8c10-e577c53649e8 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:53:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:56 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance destroyed successfully.
Aug 09 20:53:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:58 user nova-compute[72620]: WARNING nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:53:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:53:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:53:58 user nova-compute[72620]: WARNING nova.compute.manager [req-69d32d80-bf3c-4492-ae40-a52664520127 req-b69c5841-34b4-4233-a3e4-ee788fe8833e service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state rescued and task_state unrescuing.
Aug 09 20:53:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for fb3d20c3-8fc1-4661-9da8-d83cd6fced50 due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614440.4011073, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Resumed (Lifecycle Event)
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-8f45d817-6c4d-4bf4-9549-4649f4dfeac7 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614440.4023206, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:00 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Started (Lifecycle Event)
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:00 user nova-compute[72620]: WARNING nova.compute.manager [req-6329c2ed-4a0f-4351-99eb-b9bac3edc97b req-f2408f37-ed7a-47e1-908e-efa6bee29528 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state None.
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvoJbNRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:00 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:00 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:00 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[046fa6cc-a6d0-4556-9920-ffcd546f203f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:54:00 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48196a6-73a7-42c5-a4ec-4edd2a60ed61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5] added
Aug 09 20:54:00 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab44868-f558-4937-aad4-b8a07e297fcc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5ce7a4-8bf7-4f51-9434-30e284e1f58a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvoJbNRS {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvoJbNRS" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2124a881-36c4-4f17-bf32-02bd0dbbddca]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PvoJbNRS'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[208fa148-84e2-4784-81d1-99cf1e81b52b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[629b346b-5ee6-444f-a2f7-785beef5aace]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2adc253-b9c9-4b14-9f49-667d5cbb0d2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260]
Aug 09 20:54:01 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260] successful.
Aug 09 20:54:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a034c7c-59ad-416b-928d-cd1c8923c6f4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f42925-f25c-47b2-86b9-fa4654f2295a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:01 user nova-compute[72620]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)
Aug 09 20:54:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[636f807d-35b3-4043-bf7a-28111e2c4b9d]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvoJbNRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614426.8847647, 23220e25-c7e8-4419-b412-555200a63f31 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:01 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Stopped (Lifecycle Event)
Aug 09 20:54:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e4302940-5b83-4104-8ed6-5ece723b15ef None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '26338303261303561', 'path': '/dev/sdg'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338303261303561', 'path': '/dev/sdg'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:54:02 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:54:02 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:54:02 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:54:02 user nova-compute[72620]:   <serial>c2a27a92-266f-4f9c-9e08-87dfc1cde6c5</serial>
Aug 09 20:54:02 user nova-compute[72620]: </disk>
Aug 09 20:54:02 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] No VIF found with MAC fa:16:3e:b2:6e:a6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-91066d3c-8df4-42e7-9712-6d68f3f8deed tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.629s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:54:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:54:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7143MB free_disk=25.089534759521484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 23220e25-c7e8-4419-b412-555200a63f31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance b266dec9-5c8c-42c4-8de4-61cbef595c68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 09616da6-15dc-4a79-ad1d-19554b86d529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:54:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:06 user nova-compute[72620]: INFO nova.compute.manager [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Detaching volume c2a27a92-266f-4f9c-9e08-87dfc1cde6c5
Aug 09 20:54:06 user nova-compute[72620]: INFO nova.virt.block_device [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Attempting to driver detach volume c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 from mountpoint /dev/vdb
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Attempting to detach device vdb from instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:54:06 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:54:06 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:54:06 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:54:06 user nova-compute[72620]:   <serial>c2a27a92-266f-4f9c-9e08-87dfc1cde6c5</serial>
Aug 09 20:54:06 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:54:06 user nova-compute[72620]: </disk>
Aug 09 20:54:06 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:54:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully detached device vdb from instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad from the persistent domain config.
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:54:06 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:54:06 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:54:06 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:54:06 user nova-compute[72620]:   <serial>c2a27a92-266f-4f9c-9e08-87dfc1cde6c5</serial>
Aug 09 20:54:06 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:54:06 user nova-compute[72620]: </disk>
Aug 09 20:54:06 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-1483e729-3137-470d-abf7-43fed8e5c282 req-21a1a674-b606-4a5c-bc96-7b100d81a2bb service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event volume-reimaged-54d88d46-071f-4ae4-9884-61011298d7ee {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1483e729-3137-470d-abf7-43fed8e5c282 req-21a1a674-b606-4a5c-bc96-7b100d81a2bb service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1483e729-3137-470d-abf7-43fed8e5c282 req-21a1a674-b606-4a5c-bc96-7b100d81a2bb service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1483e729-3137-470d-abf7-43fed8e5c282 req-21a1a674-b606-4a5c-bc96-7b100d81a2bb service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-1483e729-3137-470d-abf7-43fed8e5c282 req-21a1a674-b606-4a5c-bc96-7b100d81a2bb service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Processing event volume-reimaged-54d88d46-071f-4ae4-9884-61011298d7ee {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:54:06 user nova-compute[72620]: INFO nova.virt.block_device [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Booting with volume 54d88d46-071f-4ae4-9884-61011298d7ee at /dev/vda
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.utils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd87af-9bc0-461e-8289-f8e58a7b065b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[456eee41-0771-4b39-8666-4cff6d240d75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614446.685358, f6fbe0e3-8e6a-48d4-941a-b7046c225fad => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:54:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully detached device vdb from instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad from the live domain config.
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvoJbNRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:06 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa1bf93-61ca-4ead-b638-6a1a9a4d3c97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ef3ad-acf1-4f38-aa76-7fa23dd519d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7d5fb-cd6b-4ff9-b15b-5408a91bd756]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:54:06 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5527d47-69a2-497e-8fe8-29090a188397]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.utils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating existing volume attachment record: fd61d074-5fb2-489a-ab9d-6b16c4e34c77 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[219de7ca-3792-4a90-9a47-ffbd61d8768c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:06 user nova-compute[72620]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 (non-flash)
Aug 09 20:54:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5'): ({'sdg'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Removing single pathed devices sdg {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[503c4622-6511-443d-a066-eadc1f7e5faa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd48ab-a1cb-48fb-9434-479c4942d467]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Flushing IO for device /dev/sdg {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6adde6-988a-4445-af9b-97c718edbae5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a479c-b95a-4d8d-b07d-878cd222efec]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b717061-d890-444f-8383-61723f0c961f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce86fe-c378-4b62-a5da-2d4862943a88]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260]
Aug 09 20:54:07 user nova-compute[72620]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5, portal: 172.16.0.220,3260] successful.
Aug 09 20:54:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2a27a92-266f-4f9c-9e08-87dfc1cde6c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a845d9-f710-46a7-8b78-6fdc98264485]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] <== disconnect_volume: return (335ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'flavor' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-eeb3ba69-6681-4e37-9336-f52bc9e4f44f tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:54:14 user nova-compute[72620]: INFO nova.compute.claims [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Claim successful on node user
Aug 09 20:54:14 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:54:14 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:54:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.policy [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93ec7531ffb048959bb3d9e47eba8485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe04d8fa9624440a7e46af39c41a498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:54:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Creating image(s)
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "/opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "/opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.part --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.virt.images [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] e07d40c3-6f45-4507-8d04-c1ca164c4384 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.part /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:15 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Successfully created port: a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.part /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.converted" returned: 0 in 0.320s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:54:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Creating image(s)
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Ensure instance console log exists: /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start _get_guest_xml network_info=[{"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23220e25-c7e8-4419-b412-555200a63f31', 'attached_at': '', 'detached_at': '', 'volume_id': '54d88d46-071f-4ae4-9884-61011298d7ee', 'serial': '54d88d46-071f-4ae4-9884-61011298d7ee'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'fd61d074-5fb2-489a-ab9d-6b16c4e34c77', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.031s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 20:54:16 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:16 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:16 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:16 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9760598-7ae1-4e40-8b9c-9e5e2f2b8659]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:54:16 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146a827-c726-49ab-ade8-fbf85b30be33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee] added
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4728376-d4d2-4c63-bb12-c46151a09c8e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[402434c4-e8e6-4d7a-9116-2850d2d0e9fe]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjwRvQyC {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b,backing_fmt=raw /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KjwRvQyC" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f3ed9-f736-422b-a4a6-550c69eb134d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KjwRvQyC'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b,backing_fmt=raw /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk 1073741824" returned: 0 in 0.051s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "835ce913da3b6d543eabee8d414e4b7ec4ac230b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[91debbe4-035c-431f-8fe9-0db5a5eb10dd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3c229e-0d6d-4446-ae1e-e6855c361c8b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f2fd9-d992-417e-804b-f472e02abf3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]
Aug 09 20:54:16 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca9a1c-eedf-4f94-aba2-7b92d2f0c97a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f99632-1d87-4ef6-af20-dee39cc66574]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:16 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9db455-5427-4e24-8132-fb0f3f65bcc5]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Successfully updated port: a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing instance network info cache due to event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Cannot resize image /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'migration_context' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Ensure instance console log exists: /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance network_info: |[{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.neutron [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Start _get_guest_xml network_info=[{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:54:11Z,direct_url=<?>,disk_format='qcow2',id=e07d40c3-6f45-4507-8d04-c1ca164c4384,min_disk=0,min_ram=0,name='tempest-scenario-img--2024633476',owner='4fe04d8fa9624440a7e46af39c41a498',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:54:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e07d40c3-6f45-4507-8d04-c1ca164c4384'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:54:17 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:17 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:54:11Z,direct_url=<?>,disk_format='qcow2',id=e07d40c3-6f45-4507-8d04-c1ca164c4384,min_disk=0,min_ram=0,name='tempest-scenario-img--2024633476',owner='4fe04d8fa9624440a7e46af39c41a498',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:54:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186225411',display_name='tempest-TestMinimumBasicScenario-server-186225411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186225411',id=27,image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6s+8X0h1wXo7OtEUCp/JOUf/76fcMWk+/+jkw2WC+i+Pd66x0PpEF9jVjC77yx3taj9lAEexJqfVr+Jdlx+Ro5tDH5x71Vsxn7SSeAu57T65Pgrwo+7YszilVOkpsQ5g==',key_name='tempest-TestMinimumBasicScenario-769244683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-on7w08zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:54:15Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=5cff4311-d84e-497e-a2c3-41447252fe6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:54:17 user nova-compute[72620]:   <uuid>5cff4311-d84e-497e-a2c3-41447252fe6b</uuid>
Aug 09 20:54:17 user nova-compute[72620]:   <name>instance-0000001b</name>
Aug 09 20:54:17 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:54:17 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:54:17 user nova-compute[72620]:   <metadata>
Aug 09 20:54:17 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:54:17 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:name>tempest-TestMinimumBasicScenario-server-186225411</nova:name>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:54:17</nova:creationTime>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:54:17 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:owner>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:user uuid="93ec7531ffb048959bb3d9e47eba8485">tempest-TestMinimumBasicScenario-931784319-project-member</nova:user>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:project uuid="4fe04d8fa9624440a7e46af39c41a498">tempest-TestMinimumBasicScenario-931784319</nova:project>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:owner>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:root type="image" uuid="e07d40c3-6f45-4507-8d04-c1ca164c4384"/>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:ports>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:port uuid="a16247f8-f62c-4789-896c-3fb903cc0bbf">
Aug 09 20:54:17 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:54:17 user nova-compute[72620]:         </nova:port>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:ports>
Aug 09 20:54:17 user nova-compute[72620]:     </nova:instance>
Aug 09 20:54:17 user nova-compute[72620]:   </metadata>
Aug 09 20:54:17 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:54:17 user nova-compute[72620]:     <system>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="serial">5cff4311-d84e-497e-a2c3-41447252fe6b</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="uuid">5cff4311-d84e-497e-a2c3-41447252fe6b</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:54:17 user nova-compute[72620]:     </system>
Aug 09 20:54:17 user nova-compute[72620]:   </sysinfo>
Aug 09 20:54:17 user nova-compute[72620]:   <os>
Aug 09 20:54:17 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:54:17 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:54:17 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:54:17 user nova-compute[72620]:   </os>
Aug 09 20:54:17 user nova-compute[72620]:   <features>
Aug 09 20:54:17 user nova-compute[72620]:     <acpi/>
Aug 09 20:54:17 user nova-compute[72620]:     <apic/>
Aug 09 20:54:17 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:54:17 user nova-compute[72620]:   </features>
Aug 09 20:54:17 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:54:17 user nova-compute[72620]:   </clock>
Aug 09 20:54:17 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:54:17 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:54:17 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:54:17 user nova-compute[72620]:   </cpu>
Aug 09 20:54:17 user nova-compute[72620]:   <devices>
Aug 09 20:54:17 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:54:17 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:54:17 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk"/>
Aug 09 20:54:17 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:     </disk>
Aug 09 20:54:17 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:54:17 user nova-compute[72620]:       <mac address="fa:16:3e:54:23:86"/>
Aug 09 20:54:17 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:54:17 user nova-compute[72620]:       <target dev="tapa16247f8-f6"/>
Aug 09 20:54:17 user nova-compute[72620]:     </interface>
Aug 09 20:54:17 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:54:17 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/console.log" append="off"/>
Aug 09 20:54:17 user nova-compute[72620]:     </serial>
Aug 09 20:54:17 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:54:17 user nova-compute[72620]:     <video>
Aug 09 20:54:17 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:     </video>
Aug 09 20:54:17 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:54:17 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:54:17 user nova-compute[72620]:     </rng>
Aug 09 20:54:17 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:54:17 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:54:17 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:54:17 user nova-compute[72620]:     </memballoon>
Aug 09 20:54:17 user nova-compute[72620]:   </devices>
Aug 09 20:54:17 user nova-compute[72620]: </domain>
Aug 09 20:54:17 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186225411',display_name='tempest-TestMinimumBasicScenario-server-186225411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186225411',id=27,image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6s+8X0h1wXo7OtEUCp/JOUf/76fcMWk+/+jkw2WC+i+Pd66x0PpEF9jVjC77yx3taj9lAEexJqfVr+Jdlx+Ro5tDH5x71Vsxn7SSeAu57T65Pgrwo+7YszilVOkpsQ5g==',key_name='tempest-TestMinimumBasicScenario-769244683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-on7w08zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:54:15Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=5cff4311-d84e-497e-a2c3-41447252fe6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG os_vif [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa16247f8-f6, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa16247f8-f6, col_values=(('external_ids', {'iface-id': 'a16247f8-f62c-4789-896c-3fb903cc0bbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:23:86', 'vm-uuid': '5cff4311-d84e-497e-a2c3-41447252fe6b'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: INFO os_vif [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6')
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No VIF found with MAC fa:16:3e:54:23:86, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26332633265386266', 'path': '/dev/sdf'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332633265386266', 'path': '/dev/sdf'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2016797239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:54:17 user nova-compute[72620]:   <uuid>23220e25-c7e8-4419-b412-555200a63f31</uuid>
Aug 09 20:54:17 user nova-compute[72620]:   <name>instance-00000016</name>
Aug 09 20:54:17 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:54:17 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:54:17 user nova-compute[72620]:   <metadata>
Aug 09 20:54:17 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:54:17 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2016797239</nova:name>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:54:16</nova:creationTime>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:54:17 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:owner>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:user uuid="dff7b04b13c74b37b5173df56d20243d">tempest-ServerActionsV293TestJSON-925057936-project-member</nova:user>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:project uuid="4f8a02e7fda64d4c9b0bde7b090bd821">tempest-ServerActionsV293TestJSON-925057936</nova:project>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:owner>
Aug 09 20:54:17 user nova-compute[72620]:       <nova:ports>
Aug 09 20:54:17 user nova-compute[72620]:         <nova:port uuid="f57f6189-a1dc-4a63-81e8-eb0c376f34a4">
Aug 09 20:54:17 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:54:17 user nova-compute[72620]:         </nova:port>
Aug 09 20:54:17 user nova-compute[72620]:       </nova:ports>
Aug 09 20:54:17 user nova-compute[72620]:     </nova:instance>
Aug 09 20:54:17 user nova-compute[72620]:   </metadata>
Aug 09 20:54:17 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:54:17 user nova-compute[72620]:     <system>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="serial">23220e25-c7e8-4419-b412-555200a63f31</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="uuid">23220e25-c7e8-4419-b412-555200a63f31</entry>
Aug 09 20:54:17 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:54:17 user nova-compute[72620]:     </system>
Aug 09 20:54:17 user nova-compute[72620]:   </sysinfo>
Aug 09 20:54:17 user nova-compute[72620]:   <os>
Aug 09 20:54:17 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:54:17 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:54:17 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:54:17 user nova-compute[72620]:   </os>
Aug 09 20:54:17 user nova-compute[72620]:   <features>
Aug 09 20:54:17 user nova-compute[72620]:     <acpi/>
Aug 09 20:54:17 user nova-compute[72620]:     <apic/>
Aug 09 20:54:17 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:54:17 user nova-compute[72620]:   </features>
Aug 09 20:54:17 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:54:17 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:54:17 user nova-compute[72620]:   </clock>
Aug 09 20:54:17 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:54:17 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:54:17 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:54:17 user nova-compute[72620]:   </cpu>
Aug 09 20:54:17 user nova-compute[72620]:   <devices>
Aug 09 20:54:17 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:54:17 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:54:17 user nova-compute[72620]:       <source dev="/dev/sdf"/>
Aug 09 20:54:17 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:       <serial>54d88d46-071f-4ae4-9884-61011298d7ee</serial>
Aug 09 20:54:17 user nova-compute[72620]:     </disk>
Aug 09 20:54:17 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:54:17 user nova-compute[72620]:       <mac address="fa:16:3e:3d:56:b5"/>
Aug 09 20:54:17 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:54:17 user nova-compute[72620]:       <target dev="tapf57f6189-a1"/>
Aug 09 20:54:17 user nova-compute[72620]:     </interface>
Aug 09 20:54:17 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:54:17 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31/console.log" append="off"/>
Aug 09 20:54:17 user nova-compute[72620]:     </serial>
Aug 09 20:54:17 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:54:17 user nova-compute[72620]:     <video>
Aug 09 20:54:17 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:17 user nova-compute[72620]:     </video>
Aug 09 20:54:17 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:54:17 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:54:17 user nova-compute[72620]:     </rng>
Aug 09 20:54:17 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:54:17 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:54:17 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:54:17 user nova-compute[72620]:     </memballoon>
Aug 09 20:54:17 user nova-compute[72620]:   </devices>
Aug 09 20:54:17 user nova-compute[72620]: </domain>
Aug 09 20:54:17 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2016797239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG os_vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf57f6189-a1, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf57f6189-a1, col_values=(('external_ids', {'iface-id': 'f57f6189-a1dc-4a63-81e8-eb0c376f34a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:56:b5', 'vm-uuid': '23220e25-c7e8-4419-b412-555200a63f31'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:17 user nova-compute[72620]: INFO os_vif [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1')
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] No VIF found with MAC fa:16:3e:3d:56:b5, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG nova.network.neutron [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updated VIF entry in instance network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG nova.network.neutron [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-465b2d1a-7cb8-402d-80fc-f6f24d9ea9c8 req-7af77892-51f8-4f74-b4a2-c2e7fe5fdf52 service nova] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquired lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:54:18 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'info_cache' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Releasing lock "refresh_cache-c5872c41-5db7-42aa-9145-108eec912a53" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance destroyed successfully.
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'resources' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG os_vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33d0fedc-a4, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:19 user nova-compute[72620]: INFO os_vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start _get_guest_xml network_info=[{"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'numa_topology' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'pci_devices' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:54:19 user nova-compute[72620]:   <uuid>c5872c41-5db7-42aa-9145-108eec912a53</uuid>
Aug 09 20:54:19 user nova-compute[72620]:   <name>instance-0000000f</name>
Aug 09 20:54:19 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:54:19 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:54:19 user nova-compute[72620]:   <metadata>
Aug 09 20:54:19 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:54:19 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeTestJSON-server-1990795843</nova:name>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:54:19</nova:creationTime>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:54:19 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:54:19 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:owner>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:user uuid="e7b0bb7bc6434f0b81a7479269348a72">tempest-AttachVolumeTestJSON-12994001-project-member</nova:user>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:project uuid="47da24a245bc4b0e9eb5cb14adf689d6">tempest-AttachVolumeTestJSON-12994001</nova:project>
Aug 09 20:54:19 user nova-compute[72620]:       </nova:owner>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:54:19 user nova-compute[72620]:       <nova:ports>
Aug 09 20:54:19 user nova-compute[72620]:         <nova:port uuid="33d0fedc-a465-457a-959d-c054e1e8a0e4">
Aug 09 20:54:19 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 20:54:19 user nova-compute[72620]:         </nova:port>
Aug 09 20:54:19 user nova-compute[72620]:       </nova:ports>
Aug 09 20:54:19 user nova-compute[72620]:     </nova:instance>
Aug 09 20:54:19 user nova-compute[72620]:   </metadata>
Aug 09 20:54:19 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:54:19 user nova-compute[72620]:     <system>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="serial">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="uuid">c5872c41-5db7-42aa-9145-108eec912a53</entry>
Aug 09 20:54:19 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:54:19 user nova-compute[72620]:     </system>
Aug 09 20:54:19 user nova-compute[72620]:   </sysinfo>
Aug 09 20:54:19 user nova-compute[72620]:   <os>
Aug 09 20:54:19 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:54:19 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:54:19 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:54:19 user nova-compute[72620]:   </os>
Aug 09 20:54:19 user nova-compute[72620]:   <features>
Aug 09 20:54:19 user nova-compute[72620]:     <acpi/>
Aug 09 20:54:19 user nova-compute[72620]:     <apic/>
Aug 09 20:54:19 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:54:19 user nova-compute[72620]:   </features>
Aug 09 20:54:19 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:54:19 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:54:19 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:54:19 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:54:19 user nova-compute[72620]:   </clock>
Aug 09 20:54:19 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:54:19 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:54:19 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:54:19 user nova-compute[72620]:   </cpu>
Aug 09 20:54:19 user nova-compute[72620]:   <devices>
Aug 09 20:54:19 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:54:19 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:54:19 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk"/>
Aug 09 20:54:19 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:54:19 user nova-compute[72620]:     </disk>
Aug 09 20:54:19 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:54:19 user nova-compute[72620]:       <mac address="fa:16:3e:aa:60:d6"/>
Aug 09 20:54:19 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:19 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:54:19 user nova-compute[72620]:       <target dev="tap33d0fedc-a4"/>
Aug 09 20:54:19 user nova-compute[72620]:     </interface>
Aug 09 20:54:19 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:54:19 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/console.log" append="off"/>
Aug 09 20:54:19 user nova-compute[72620]:     </serial>
Aug 09 20:54:19 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:54:19 user nova-compute[72620]:     <video>
Aug 09 20:54:19 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:54:19 user nova-compute[72620]:     </video>
Aug 09 20:54:19 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:54:19 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:54:19 user nova-compute[72620]:     </rng>
Aug 09 20:54:19 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:54:19 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:54:19 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:54:19 user nova-compute[72620]:     </memballoon>
Aug 09 20:54:19 user nova-compute[72620]:   </devices>
Aug 09 20:54:19 user nova-compute[72620]: </domain>
Aug 09 20:54:19 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:20 user nova-compute[72620]: WARNING nova.compute.manager [req-6bffe37e-4a70-42a5-9e84-6af9a3d848b3 req-d9d961a2-5631-4b30-a907-0f8623c3f564 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state building and task_state spawning.
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Cannot resize image /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'migration_context' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:52:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG os_vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33d0fedc-a4, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33d0fedc-a4, col_values=(('external_ids', {'iface-id': '33d0fedc-a465-457a-959d-c054e1e8a0e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:60:d6', 'vm-uuid': 'c5872c41-5db7-42aa-9145-108eec912a53'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: INFO os_vif [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:22 user nova-compute[72620]: WARNING nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state building and task_state spawning.
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:22 user nova-compute[72620]: WARNING nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:22 user nova-compute[72620]: WARNING nova.compute.manager [req-36e16701-0381-4f16-90ec-ed83e7b59235 req-424c627f-c319-4bf2-8119-53b3fcb2f7fc service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state active and task_state rebuild_spawning.
Aug 09 20:54:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Terminating instance
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-unplugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] No waiting events found dispatching network-vif-unplugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-4314176e-b3ba-4cf9-908b-4478d52df9aa req-728db947-f47d-48a1-967d-5825bb487ed7 service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-unplugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614463.703701, 23220e25-c7e8-4419-b412-555200a63f31 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Resumed (Lifecycle Event)
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance spawned successfully.
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614463.70901, 23220e25-c7e8-4419-b412-555200a63f31 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Started (Lifecycle Event)
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614463.9449804, 5cff4311-d84e-497e-a2c3-41447252fe6b => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] VM Resumed (Lifecycle Event)
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance spawned successfully.
Aug 09 20:54:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72620) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Instance destroyed successfully.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.objects.instance [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid b266dec9-5c8c-42c4-8de4-61cbef595c68 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-120184176',display_name='tempest-TestVolumeBootPattern-server-120184176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-120184176',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-wy4fs744',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:52:54Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=b266dec9-5c8c-42c4-8de4-61cbef595c68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "address": "fa:16:3e:32:7c:6f", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap496a2970-55", "ovs_interfaceid": "496a2970-55ae-4edc-bbb9-9dc4de5dae08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_vif [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614463.9486547, 5cff4311-d84e-497e-a2c3-41447252fe6b => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] VM Started (Lifecycle Event)
Aug 09 20:54:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap496a2970-55, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:54:24 user nova-compute[72620]: INFO os_vif [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:7c:6f,bridge_name='br-int',has_traffic_filtering=True,id=496a2970-55ae-4edc-bbb9-9dc4de5dae08,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap496a2970-55')
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1483e729-3137-470d-abf7-43fed8e5c282 tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjgoBCYv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:24 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7272c-006e-4285-8119-dc24e3872164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf1ecf-727b-48f6-9650-b79d8fa42ce9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:24 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6a733eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f578370c-94ac-434f-ac5f-671e074cd9e4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[455af033-6720-406f-828f-729ec99595d1]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640321e-1ce1-4267-b6f3-875700da1494]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Took 9.88 seconds to build instance.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:24 user nova-compute[72620]: WARNING nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state powering-on.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:24 user nova-compute[72620]: WARNING nova.compute.manager [req-b50513a8-160e-4c5c-a3aa-372dc399d390 req-3fccffe4-ef65-4777-a35d-804a52e715c5 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state stopped and task_state powering-on.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-changed-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Refreshing instance network info cache due to event network-changed-82f29ab5-f1c5-4236-aea5-452601072106. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] Acquiring lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] Acquired lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Refreshing network info cache for port 82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0d8b6ecd-7338-4819-b6bf-d152924ac9aa tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.008s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.084s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b610dca-2d9f-4a24-adb2-7aaa3a39ea6e]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2ad67317', '/dev/disk/by-id/scsi-1SCST_BIO2ad67317-f8a4e8abaf3544ad', '/dev/disk/by-id/scsi-26638613465386162') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c02e4a-98b9-4d1c-b94e-5049d1b78ebe]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd37f5-a0ae-44cf-9de0-962e6faa5a7c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[03181302-8bd4-432f-adcd-2b98905448a3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260]
Aug 09 20:54:24 user nova-compute[72620]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143, portal: 172.16.0.220,3260] successful.
Aug 09 20:54:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e1979ce3-8f31-436b-969c-86bbc7c84143 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69e677-714f-4b68-8fc9-68ce6edd493b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (419ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Deleting instance files /opt/stack/data/nova/instances/b266dec9-5c8c-42c4-8de4-61cbef595c68_del
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Deletion of /opt/stack/data/nova/instances/b266dec9-5c8c-42c4-8de4-61cbef595c68_del complete
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.objects.instance [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Ignoring supplied device name: /dev/vdb
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614464.7374804, c5872c41-5db7-42aa-9145-108eec912a53 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Resumed (Lifecycle Event)
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance rebooted successfully.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e9206c59-11c5-48a1-aa7f-87915f9237d4 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614464.7390466, c5872c41-5db7-42aa-9145-108eec912a53 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Started (Lifecycle Event)
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updated VIF entry in instance network info cache for port 82f29ab5-f1c5-4236-aea5-452601072106. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating instance_info_cache with network_info: [{"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:24 user nova-compute[72620]: INFO nova.compute.manager [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Attaching volume 2b176ba9-05a6-47e8-865d-6843eabee0ae to /dev/vdb
Aug 09 20:54:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c261ee2f-6a4d-4625-bcf9-3ac161a2a807 req-bb86cbc4-9a1c-4fdb-b508-5f52da090bb6 service nova] Releasing lock "refresh_cache-09616da6-15dc-4a79-ad1d-19554b86d529" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.utils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca3f039-672d-455b-8e9a-17d8668de191]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16feb511-469d-42e6-a8e9-3c2820df0068]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e8cdeb-ce64-443b-a8c8-7b29689ba970]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e991c5-7e00-437b-9883-1df53c606a7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:54:25 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3908ce-1e7b-437d-bc9c-cda4f4f4db0e]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG os_brick.utils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating existing volume attachment record: e5919971-c672-43b3-8c07-e659228fabdc {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:25 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Took 0.64 seconds to deallocate network for instance.
Aug 09 20:54:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] Acquiring lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] No waiting events found dispatching network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:25 user nova-compute[72620]: WARNING nova.compute.manager [req-dee3ca7e-c531-4f92-afd2-2e7ba8c9d336 req-961ee53f-b120-4c2f-a7f0-b065049e3f6a service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received unexpected event network-vif-plugged-496a2970-55ae-4edc-bbb9-9dc4de5dae08 for instance with vm_state active and task_state deleting.
Aug 09 20:54:26 user nova-compute[72620]: INFO nova.compute.manager [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Took 0.90 seconds to detach 1 volumes for instance.
Aug 09 20:54:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Deleting volume: e1979ce3-8f31-436b-969c-86bbc7c84143 {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-33a36f64-e7ff-40c4-a191-bd4f6d32ffa8 req-4c11002e-4f5f-4f5d-a2bb-d30d34fb3b6b service nova] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Received event network-vif-deleted-496a2970-55ae-4edc-bbb9-9dc4de5dae08 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:54:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:26 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance b266dec9-5c8c-42c4-8de4-61cbef595c68
Aug 09 20:54:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-38d3e456-ed65-4b6e-807f-a47c5679f924 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "b266dec9-5c8c-42c4-8de4-61cbef595c68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.769s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614463.986213, b266dec9-5c8c-42c4-8de4-61cbef595c68 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:54:39 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] VM Stopped (Lifecycle Event)
Aug 09 20:54:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-55b95fc9-498f-4f89-bc18-ef74581a2baa None None] [instance: b266dec9-5c8c-42c4-8de4-61cbef595c68] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKxOqUvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:54:39 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:39 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:54:39 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87815e3-55bb-45a0-82c4-131f97ee2886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:54:39 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47d4fbe-87ba-4795-8016-68adbffd748d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae] added
Aug 09 20:54:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f6be4b-bd74-458a-86a1-16dd6b21047c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86aacfe-cf4b-4f7a-9022-cccba8703fab]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKxOqUvD {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QKxOqUvD" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[168516fa-8791-4157-b632-b221cb871a46]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QKxOqUvD'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98359d10-c773-48bc-b3f6-9463275f1590]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfece63-3d8e-40bd-a54b-551b562978dd]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:39 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2801410c-c894-4b86-87e6-7cd83fbf959e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260]
Aug 09 20:54:40 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260] successful.
Aug 09 20:54:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9515d1b1-b78d-4b4c-b97f-185f46cd24ee]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcc7098-eeb4-4d67-bde0-cae6e9b609ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)
Aug 09 20:54:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:54:40 user nova-compute[72620]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)
Aug 09 20:54:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa7e170-dad9-4600-9cbf-2ee1f4a43e2f]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:54:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKxOqUvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23233646230613039', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233646230613039', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.objects.instance [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:54:41 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:54:41 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:54:41 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:54:41 user nova-compute[72620]:   <serial>2b176ba9-05a6-47e8-865d-6843eabee0ae</serial>
Aug 09 20:54:41 user nova-compute[72620]: </disk>
Aug 09 20:54:41 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:54:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No VIF found with MAC fa:16:3e:28:df:2c, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:54:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-30196d38-1269-47eb-b31e-aee1b2d25219 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.120s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing instance network info cache due to event network-changed-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] Acquiring lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] Acquired lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Refreshing network info cache for port a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:57 user nova-compute[72620]: INFO nova.compute.manager [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Terminating instance
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updated VIF entry in instance network info cache for port a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating instance_info_cache with network_info: [{"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d83ede6-dc3a-4494-9c76-2bdb2eeb4a4b req-d496aef6-130b-4cbf-af37-4be3fc7d7a1a service nova] Releasing lock "refresh_cache-f6fbe0e3-8e6a-48d4-941a-b7046c225fad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-unplugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] No waiting events found dispatching network-vif-unplugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-9f6733e9-ebcd-453c-8be1-078c44208de6 req-6e26d9c6-5135-477b-b4c7-28605ca96ab9 service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-unplugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:54:57 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Instance destroyed successfully.
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'resources' on Instance uuid f6fbe0e3-8e6a-48d4-941a-b7046c225fad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:51:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-836806542',display_name='tempest-TestStampPattern-server-836806542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-836806542',id=23,image_ref='95a8c17d-ef8d-4053-ae14-c0cb4b04d284',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-0d16qi2t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7b0d54ec-1ee4-498d-adb0-68f98faa4db5',image_min_disk='1',image_min_ram='0',image_owner_id='355c9ed1b3bf41c79a2e58158b3469d6',image_owner_project_name='tempest-TestStampPattern-1200029945',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1200029945-project-member',image_user_id='99eca3cb88e349c38b46fdd75ad21c69',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:52:07Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=f6fbe0e3-8e6a-48d4-941a-b7046c225fad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "address": "fa:16:3e:b2:6e:a6", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c4b3b1-bf", "ovs_interfaceid": "a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG os_vif [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7c4b3b1-bf, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:54:58 user nova-compute[72620]: INFO os_vif [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:6e:a6,bridge_name='br-int',has_traffic_filtering=True,id=a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c4b3b1-bf')
Aug 09 20:54:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Deleting instance files /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad_del
Aug 09 20:54:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Deletion of /opt/stack/data/nova/instances/f6fbe0e3-8e6a-48d4-941a-b7046c225fad_del complete
Aug 09 20:54:58 user nova-compute[72620]: INFO nova.compute.manager [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:54:58 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Took 0.54 seconds to deallocate network for instance.
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-028edaec-5dc0-4fd3-b168-3b82d0bf4af3 req-d5fdeaa0-83a8-43c0-97c3-0a40f5e37baa service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-deleted-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:59 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Deleted allocations for instance f6fbe0e3-8e6a-48d4-941a-b7046c225fad
Aug 09 20:54:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f4918d8c-6fbb-43dc-b78c-daba5fa08a88 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.151s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] Acquiring lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] Lock "f6fbe0e3-8e6a-48d4-941a-b7046c225fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:54:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] No waiting events found dispatching network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:54:59 user nova-compute[72620]: WARNING nova.compute.manager [req-638fa6dd-0791-4e9b-a8e7-91a0457ba816 req-81c6c399-bd57-4a34-848f-459c7329a45e service nova] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Received unexpected event network-vif-plugged-a7c4b3b1-bfd7-4f90-bf59-e29afbd457a7 for instance with vm_state deleted and task_state None.
Aug 09 20:55:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:55:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:55:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=6971MB free_disk=25.04785919189453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 23220e25-c7e8-4419-b412-555200a63f31 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 09616da6-15dc-4a79-ad1d-19554b86d529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5cff4311-d84e-497e-a2c3-41447252fe6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:55:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:55:06 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:55:06 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:55:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:55:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:55:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:12 user nova-compute[72620]: INFO nova.compute.manager [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] instance snapshotting
Aug 09 20:55:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Beginning live snapshot process
Aug 09 20:55:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json -f qcow2 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7.delta 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7.delta 1073741824" returned: 0 in 0.055s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 09 20:55:12 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614497.99264, f6fbe0e3-8e6a-48d4-941a-b7046c225fad => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:55:12 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] VM Stopped (Lifecycle Event)
Aug 09 20:55:13 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9420aa1d-6c0f-4be6-a680-def1c1d9c7b0 None None] [instance: f6fbe0e3-8e6a-48d4-941a-b7046c225fad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:55:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72620) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 09 20:55:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 09 20:55:14 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:55:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7.delta /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7.delta /opt/stack/data/nova/instances/snapshots/tmpqwpgoj5t/17ac3f14a1034c76867ef18a09fcf1c7" returned: 0 in 0.527s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Snapshot extracted, beginning image upload
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:15 user nova-compute[72620]: INFO nova.compute.manager [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Detaching volume 2b176ba9-05a6-47e8-865d-6843eabee0ae
Aug 09 20:55:15 user nova-compute[72620]: INFO nova.virt.block_device [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Attempting to driver detach volume 2b176ba9-05a6-47e8-865d-6843eabee0ae from mountpoint /dev/vdb
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Attempting to detach device vdb from instance 09616da6-15dc-4a79-ad1d-19554b86d529 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:55:15 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:55:15 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:55:15 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:55:15 user nova-compute[72620]:   <serial>2b176ba9-05a6-47e8-865d-6843eabee0ae</serial>
Aug 09 20:55:15 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:55:15 user nova-compute[72620]: </disk>
Aug 09 20:55:15 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:55:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully detached device vdb from instance 09616da6-15dc-4a79-ad1d-19554b86d529 from the persistent domain config.
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09616da6-15dc-4a79-ad1d-19554b86d529 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:55:15 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:55:15 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 20:55:15 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:55:15 user nova-compute[72620]:   <serial>2b176ba9-05a6-47e8-865d-6843eabee0ae</serial>
Aug 09 20:55:15 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:55:15 user nova-compute[72620]: </disk>
Aug 09 20:55:15 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614515.9270096, 09616da6-15dc-4a79-ad1d-19554b86d529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:55:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully detached device vdb from instance 09616da6-15dc-4a79-ad1d-19554b86d529 from the live domain config.
Aug 09 20:55:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKxOqUvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:15 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df540ce-b7b0-44cd-921a-9a579a8e3f7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfa6bf4-1de4-4dd4-b4f3-f827fa1542cc]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)
Aug 09 20:55:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:15 user nova-compute[72620]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae (non-flash)
Aug 09 20:55:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c304d1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e1874d-c2fb-44a6-9540-53d306c7ec4b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4155542-e91d-472a-be69-860a8b1797e4]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a083781d-fafb-4527-b296-6f777ae9b4f2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[59972b37-db2d-4386-a10f-bff83186e1c7]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e119d3-3031-4596-a801-5387d01b96e5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec68cb0-0440-441a-9d69-66145ee02d99]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260]
Aug 09 20:55:16 user nova-compute[72620]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae, portal: 172.16.0.220,3260] successful.
Aug 09 20:55:16 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6939f9-02d9-46ec-9d1b-1b760c1644ec]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== disconnect_volume: return (292ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:55:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Snapshot image upload complete
Aug 09 20:55:16 user nova-compute[72620]: INFO nova.compute.manager [None req-deb66701-a28e-431e-b0d0-33aed22ce0aa tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Took 4.88 seconds to snapshot the instance on the hypervisor.
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c1e6c88-9976-4a00-ae62-42ed3be93319 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.782s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.653s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:17 user nova-compute[72620]: INFO nova.compute.manager [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Terminating instance
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Instance destroyed successfully.
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'resources' on Instance uuid 09616da6-15dc-4a79-ad1d-19554b86d529 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:52:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1753197509',display_name='tempest-VolumesSnapshotTestJSON-instance-1753197509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1753197509',id=25,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEhAOZCFBQHz4eGVuW0rl9lALqv+isydb1ngIW+MHf2djBgrBHZB2axPyGUG28u8OS87TZkc2QPZnkK7L6I7DK3036ChmAuKJG0TXNjANvxAti3iqOEVhRokD+MuYMc8A==',key_name='tempest-keypair-103170811',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-h2e2wq4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=09616da6-15dc-4a79-ad1d-19554b86d529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "82f29ab5-f1c5-4236-aea5-452601072106", "address": "fa:16:3e:28:df:2c", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82f29ab5-f1", "ovs_interfaceid": "82f29ab5-f1c5-4236-aea5-452601072106", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_vif [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82f29ab5-f1, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:17 user nova-compute[72620]: INFO os_vif [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:df:2c,bridge_name='br-int',has_traffic_filtering=True,id=82f29ab5-f1c5-4236-aea5-452601072106,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82f29ab5-f1')
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QKxOqUvD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b176ba9-05a6-47e8-865d-6843eabee0ae', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30fbcd-8972-479e-9be5-33418bf727af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-unplugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] No waiting events found dispatching network-vif-unplugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-ba2577c4-ed44-4860-9a05-4c23b96b9fca req-4d3d3cc1-1587-4a41-a6df-13e4d32c5875 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-unplugged-82f29ab5-f1c5-4236-aea5-452601072106 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[51757c4c-048d-4579-80f8-577b3bd0505e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:17 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d29a9e0>, {}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Disconnecting from: [] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== disconnect_volume: return (56ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:55:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Deleting instance files /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529_del
Aug 09 20:55:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Deletion of /opt/stack/data/nova/instances/09616da6-15dc-4a79-ad1d-19554b86d529_del complete
Aug 09 20:55:18 user nova-compute[72620]: INFO nova.compute.manager [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 09 20:55:18 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-05338ad5-8e5b-49b8-ab24-0175c406761c req-183e1d58-d203-47d1-a595-3c97272c4bd3 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-deleted-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:18 user nova-compute[72620]: INFO nova.compute.manager [req-05338ad5-8e5b-49b8-ab24-0175c406761c req-183e1d58-d203-47d1-a595-3c97272c4bd3 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Neutron deleted interface 82f29ab5-f1c5-4236-aea5-452601072106; detaching it from the instance and deleting it from the info cache
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.network.neutron [req-05338ad5-8e5b-49b8-ab24-0175c406761c req-183e1d58-d203-47d1-a595-3c97272c4bd3 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:18 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Took 0.86 seconds to deallocate network for instance.
Aug 09 20:55:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-05338ad5-8e5b-49b8-ab24-0175c406761c req-183e1d58-d203-47d1-a595-3c97272c4bd3 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Detach interface failed, port_id=82f29ab5-f1c5-4236-aea5-452601072106, reason: Instance 09616da6-15dc-4a79-ad1d-19554b86d529 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:55:18 user nova-compute[72620]: WARNING nova.volume.cinder [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Attachment e5919971-c672-43b3-8c07-e659228fabdc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e5919971-c672-43b3-8c07-e659228fabdc. (HTTP 404) (Request-ID: req-b712c068-9ce5-4e47-a037-8a28dbced3df)
Aug 09 20:55:18 user nova-compute[72620]: INFO nova.compute.manager [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Took 0.02 seconds to detach 1 volumes for instance.
Aug 09 20:55:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:19 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:55:19 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:55:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:19 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Deleted allocations for instance 09616da6-15dc-4a79-ad1d-19554b86d529
Aug 09 20:55:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c95bd974-b48e-4b60-8986-dde2255c7b8e tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "09616da6-15dc-4a79-ad1d-19554b86d529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.351s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] Acquiring lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] Lock "09616da6-15dc-4a79-ad1d-19554b86d529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] No waiting events found dispatching network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:20 user nova-compute[72620]: WARNING nova.compute.manager [req-b32463ac-ca59-4a22-9741-855547a221e8 req-dd1804d5-c573-4e2c-bcd5-6a0f27798311 service nova] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Received unexpected event network-vif-plugged-82f29ab5-f1c5-4236-aea5-452601072106 for instance with vm_state deleted and task_state None.
Aug 09 20:55:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:32 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614517.8973877, 09616da6-15dc-4a79-ad1d-19554b86d529 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:55:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] VM Stopped (Lifecycle Event)
Aug 09 20:55:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-bac394a9-879c-4a9f-9494-cb827ff03502 None None] [instance: 09616da6-15dc-4a79-ad1d-19554b86d529] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:55:34 user nova-compute[72620]: INFO nova.compute.claims [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Claim successful on node user
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:55:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:55:35 user nova-compute[72620]: INFO nova.virt.block_device [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Booting with volume af4a9e94-5fe1-4aff-ad3b-d7860766e67f at /dev/vda
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.policy [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.utils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7710a-69fb-44ed-9288-a218e9cddd2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca693c3d-6459-4310-93f1-a786e0debfab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e76e8b-d040-44fe-9d13-bdfed7508c29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a994e26-6535-4d6a-ba25-eac0aa3d462a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:55:35 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:55:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a122c941-c5dc-4535-970f-b069888963ab]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG os_brick.utils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:35 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating existing volume attachment record: ee79fe93-25bd-4017-9472-19fcf81f80f2 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:55:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Successfully created port: 5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Successfully updated port: 5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-changed-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Refreshing instance network info cache due to event network-changed-5b4cf43f-2b26-43fc-8fe9-51d6f0014379. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] Acquiring lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: INFO nova.compute.manager [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Terminating instance
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-15ab2eb0-73d0-4fd5-a2e0-a27181834462 req-f41cbed7-f818-4979-bcf6-e1aab55bb2ef service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-unplugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating instance_info_cache with network_info: [{"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Instance network_info: |[{"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] Acquired lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Refreshing network info cache for port 5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:55:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Instance destroyed successfully.
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.objects.instance [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lazy-loading 'resources' on Instance uuid 23220e25-c7e8-4419-b412-555200a63f31 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2016797239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1974854128',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoCBoCeU++K8pGRZnIWQWJUJEP+Nyueow6yvpuosb38PgJsUDEMm6V5crOoQmNQ3ZUjifnryCocPWbIMnveFW/wL6xVmbnADvoUC2OLp8erhrSW5Mie8f9yANr0iujDFA==',key_name='tempest-keypair-1433751473',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:54:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f8a02e7fda64d4c9b0bde7b090bd821',ramdisk_id='',reservation_id='r-kryvzdp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-925057936',owner_user_name='tempest-ServerActionsV293TestJSON-925057936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:54:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dff7b04b13c74b37b5173df56d20243d',uuid=23220e25-c7e8-4419-b412-555200a63f31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converting VIF {"id": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "address": "fa:16:3e:3d:56:b5", "network": {"id": "619d0e43-af83-4c19-b881-04accce81dee", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1053249098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f8a02e7fda64d4c9b0bde7b090bd821", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf57f6189-a1", "ovs_interfaceid": "f57f6189-a1dc-4a63-81e8-eb0c376f34a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_vif [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf57f6189-a1, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:38 user nova-compute[72620]: INFO os_vif [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:56:b5,bridge_name='br-int',has_traffic_filtering=True,id=f57f6189-a1dc-4a63-81e8-eb0c376f34a4,network=Network(619d0e43-af83-4c19-b881-04accce81dee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf57f6189-a1')
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KjwRvQyC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:38 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c8bcb8-78e5-45c3-8993-cafcd8939537]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[467fb8da-c8da-4dd7-bc53-45dbc13cbb9c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:38 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:38 user nova-compute[72620]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee (non-flash)
Aug 09 20:55:38 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5040a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee'): ({'sdf'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Removing single pathed devices sdf {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0693ad32-fea1-4d9d-b872-8bf3ab00364b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a393e-33f7-4ed0-8429-603ed8bd0757]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Flushing IO for device /dev/sdf {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a71291d-3c27-424b-83a9-8b7e551a05e7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7913a3-4bc4-4eb3-9047-32093ee6b8ae]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26332633265386266', '/dev/disk/by-id/scsi-1SCST_BIOb46adf28-c2c2e8bfc408096b', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b46adf28') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bfeeb-d55c-4685-8c08-22a568520322]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8105e36-fab0-44ff-9b8d-d57bc76bed0a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c993b0-fe53-4396-89b5-456faa77749f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260]
Aug 09 20:55:38 user nova-compute[72620]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee, portal: 172.16.0.220,3260] successful.
Aug 09 20:55:38 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54d88d46-071f-4ae4-9884-61011298d7ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad8bd6-5148-44ca-bd89-de61c8526eca]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] <== disconnect_volume: return (298ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:55:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deleting instance files /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31_del
Aug 09 20:55:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deletion of /opt/stack/data/nova/instances/23220e25-c7e8-4419-b412-555200a63f31_del complete
Aug 09 20:55:38 user nova-compute[72620]: INFO nova.compute.manager [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updated VIF entry in instance network info cache for port 5b4cf43f-2b26-43fc-8fe9-51d6f0014379. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating instance_info_cache with network_info: [{"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0d12bdac-05a9-41e3-a754-430208a2a00a req-1e82b8aa-f8dc-434b-9161-7cefeb825917 service nova] Releasing lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:39 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:39 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Took 0.76 seconds to deallocate network for instance.
Aug 09 20:55:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] Acquiring lock "23220e25-c7e8-4419-b412-555200a63f31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] Lock "23220e25-c7e8-4419-b412-555200a63f31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] No waiting events found dispatching network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:39 user nova-compute[72620]: WARNING nova.compute.manager [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received unexpected event network-vif-plugged-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 for instance with vm_state active and task_state deleting.
Aug 09 20:55:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-b922855d-c6cc-4a52-aa1d-911b8c7df21a req-f480aeba-254d-45cc-9360-244837549788 service nova] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Received event network-vif-deleted-f57f6189-a1dc-4a63-81e8-eb0c376f34a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:39 user nova-compute[72620]: INFO nova.compute.manager [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Took 0.75 seconds to detach 1 volumes for instance.
Aug 09 20:55:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Deleting volume: 54d88d46-071f-4ae4-9884-61011298d7ee {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 20:55:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:40 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:55:40 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:55:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:40 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Deleted allocations for instance 23220e25-c7e8-4419-b412-555200a63f31
Aug 09 20:55:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5ebb9d95-bd11-40d9-8278-95cabc699c6f tempest-ServerActionsV293TestJSON-925057936 tempest-ServerActionsV293TestJSON-925057936-project-member] Lock "23220e25-c7e8-4419-b412-555200a63f31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.672s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:55:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Creating image(s)
Aug 09 20:55:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Ensure instance console log exists: /opt/stack/data/nova/instances/3d349b12-2b7a-4fc7-b045-4505a6434105/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Start _get_guest_xml network_info=[{"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXbmUKSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d349b12-2b7a-4fc7-b045-4505a6434105', 'attached_at': '', 'detached_at': '', 'volume_id': 'af4a9e94-5fe1-4aff-ad3b-d7860766e67f', 'serial': 'af4a9e94-5fe1-4aff-ad3b-d7860766e67f'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'ee79fe93-25bd-4017-9472-19fcf81f80f2', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:55:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:55:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXbmUKSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:45 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b94da37-57f2-42e7-bf97-9141799b7854]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:55:45 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c61243-0dc3-4812-9f3b-26e7e1218c81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f] added
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e799fbd-9368-498d-b5ad-0cabea9f0557]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2353df03-5bce-4849-b61f-b78779276a25]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXbmUKSi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dXbmUKSi" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8bd6c-feea-4377-9dab-f83e8d846231]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dXbmUKSi'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[29371be7-2232-4076-9966-0f76e173f301]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e51758-8ca2-4a8c-999a-77355319e889]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfb34ac-76b9-4e0e-8890-3016f636b288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260]
Aug 09 20:55:45 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260] successful.
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf1f4f-8e92-4123-a309-be372c1aad10]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3814402b-84fb-4289-98de-d5745f433c9b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:45 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:55:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9057d091-7c83-4eec-bf08-ff5dce6b8314]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:55:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXbmUKSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23661376362326136', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376362326136', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1392306553',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCV/eZgskWob22Bicu7NJTW73Y5J6D9kwmMjp5SpSM8nxO9LeJDVsYgCg73orA2d7SDks3+oDgcSRDs8NinemECUTB4iEn17ttpJF9xKEJQc1QpHTTf2Y4/QymiVxjHIA==',key_name='tempest-keypair-1936608708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-mhb4qcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=3d349b12-2b7a-4fc7-b045-4505a6434105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d349b12-2b7a-4fc7-b045-4505a6434105 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:55:46 user nova-compute[72620]:   <uuid>3d349b12-2b7a-4fc7-b045-4505a6434105</uuid>
Aug 09 20:55:46 user nova-compute[72620]:   <name>instance-0000001c</name>
Aug 09 20:55:46 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:55:46 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:55:46 user nova-compute[72620]:   <metadata>
Aug 09 20:55:46 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:55:46 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:55:46 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1392306553</nova:name>
Aug 09 20:55:46 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:55:45</nova:creationTime>
Aug 09 20:55:46 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:55:46 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:55:46 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:55:46 user nova-compute[72620]:       <nova:owner>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 20:55:46 user nova-compute[72620]:       </nova:owner>
Aug 09 20:55:46 user nova-compute[72620]:       <nova:ports>
Aug 09 20:55:46 user nova-compute[72620]:         <nova:port uuid="5b4cf43f-2b26-43fc-8fe9-51d6f0014379">
Aug 09 20:55:46 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 20:55:46 user nova-compute[72620]:         </nova:port>
Aug 09 20:55:46 user nova-compute[72620]:       </nova:ports>
Aug 09 20:55:46 user nova-compute[72620]:     </nova:instance>
Aug 09 20:55:46 user nova-compute[72620]:   </metadata>
Aug 09 20:55:46 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:55:46 user nova-compute[72620]:     <system>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="serial">3d349b12-2b7a-4fc7-b045-4505a6434105</entry>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="uuid">3d349b12-2b7a-4fc7-b045-4505a6434105</entry>
Aug 09 20:55:46 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:55:46 user nova-compute[72620]:     </system>
Aug 09 20:55:46 user nova-compute[72620]:   </sysinfo>
Aug 09 20:55:46 user nova-compute[72620]:   <os>
Aug 09 20:55:46 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:55:46 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:55:46 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:55:46 user nova-compute[72620]:   </os>
Aug 09 20:55:46 user nova-compute[72620]:   <features>
Aug 09 20:55:46 user nova-compute[72620]:     <acpi/>
Aug 09 20:55:46 user nova-compute[72620]:     <apic/>
Aug 09 20:55:46 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:55:46 user nova-compute[72620]:   </features>
Aug 09 20:55:46 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:55:46 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:55:46 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:55:46 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:55:46 user nova-compute[72620]:   </clock>
Aug 09 20:55:46 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:55:46 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:55:46 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:55:46 user nova-compute[72620]:   </cpu>
Aug 09 20:55:46 user nova-compute[72620]:   <devices>
Aug 09 20:55:46 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:55:46 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:55:46 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 20:55:46 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:55:46 user nova-compute[72620]:       <serial>af4a9e94-5fe1-4aff-ad3b-d7860766e67f</serial>
Aug 09 20:55:46 user nova-compute[72620]:     </disk>
Aug 09 20:55:46 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:55:46 user nova-compute[72620]:       <mac address="fa:16:3e:2b:b0:52"/>
Aug 09 20:55:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:55:46 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:55:46 user nova-compute[72620]:       <target dev="tap5b4cf43f-2b"/>
Aug 09 20:55:46 user nova-compute[72620]:     </interface>
Aug 09 20:55:46 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:55:46 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/3d349b12-2b7a-4fc7-b045-4505a6434105/console.log" append="off"/>
Aug 09 20:55:46 user nova-compute[72620]:     </serial>
Aug 09 20:55:46 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:55:46 user nova-compute[72620]:     <video>
Aug 09 20:55:46 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:55:46 user nova-compute[72620]:     </video>
Aug 09 20:55:46 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:55:46 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:55:46 user nova-compute[72620]:     </rng>
Aug 09 20:55:46 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:55:46 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:55:46 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:55:46 user nova-compute[72620]:     </memballoon>
Aug 09 20:55:46 user nova-compute[72620]:   </devices>
Aug 09 20:55:46 user nova-compute[72620]: </domain>
Aug 09 20:55:46 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1392306553',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCV/eZgskWob22Bicu7NJTW73Y5J6D9kwmMjp5SpSM8nxO9LeJDVsYgCg73orA2d7SDks3+oDgcSRDs8NinemECUTB4iEn17ttpJF9xKEJQc1QpHTTf2Y4/QymiVxjHIA==',key_name='tempest-keypair-1936608708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-mhb4qcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:55:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=3d349b12-2b7a-4fc7-b045-4505a6434105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG os_vif [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b4cf43f-2b, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b4cf43f-2b, col_values=(('external_ids', {'iface-id': '5b4cf43f-2b26-43fc-8fe9-51d6f0014379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:b0:52', 'vm-uuid': '3d349b12-2b7a-4fc7-b045-4505a6434105'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:46 user nova-compute[72620]: INFO os_vif [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b')
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:55:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:2b:b0:52, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing instance network info cache due to event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updated VIF entry in instance network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.network.neutron [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:47 user nova-compute[72620]: INFO nova.compute.manager [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Detaching volume 4f666b5d-87f2-4514-a225-45d43b237fc1
Aug 09 20:55:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d2b62de-3bf7-4e62-95cd-472aef6def9e req-33412a69-88ae-46b6-99d2-11419faf749b service nova] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:47 user nova-compute[72620]: INFO nova.virt.block_device [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Attempting to driver detach volume 4f666b5d-87f2-4514-a225-45d43b237fc1 from mountpoint /dev/vdb
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Attempting to detach device vdb from instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:55:47 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:55:47 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:55:47 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:55:47 user nova-compute[72620]:   <serial>4f666b5d-87f2-4514-a225-45d43b237fc1</serial>
Aug 09 20:55:47 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:55:47 user nova-compute[72620]: </disk>
Aug 09 20:55:47 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:55:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully detached device vdb from instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 from the persistent domain config.
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:55:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:55:47 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:55:47 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 20:55:47 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:55:47 user nova-compute[72620]:   <serial>4f666b5d-87f2-4514-a225-45d43b237fc1</serial>
Aug 09 20:55:47 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:55:47 user nova-compute[72620]: </disk>
Aug 09 20:55:47 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] No waiting events found dispatching network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:48 user nova-compute[72620]: WARNING nova.compute.manager [req-80f75ed4-0965-4153-a50d-1e53a2c9af0d req-53ecbaa2-2641-475c-9365-f9c372be3c06 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received unexpected event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 for instance with vm_state building and task_state spawning.
Aug 09 20:55:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614548.441605, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:55:48 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully detached device vdb from instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 from the live domain config.
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FbLDghiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:55:48 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700be85-5aea-4337-962f-53726430dc3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7343c8c2-2d27-49d4-9f7f-2dd8f3c0a764]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:55:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:55:48 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:55:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c506af2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[379cb51b-8c56-4505-bfae-8e60c9a95066]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ec935-a17f-48ec-8dbf-1d7e5f251e72]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d437b66-0986-43a4-a9c0-3b16fb4cf62b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a9dfe3-2af4-4de1-9a5b-2cfd11ee37d6]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc2ee77-077b-478c-955f-27f85a4439b3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[94625f1e-33fc-46f8-a433-0e4b6d330c80]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260]
Aug 09 20:55:48 user nova-compute[72620]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1, portal: 172.16.0.220,3260] successful.
Aug 09 20:55:48 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f666b5d-87f2-4514-a225-45d43b237fc1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512ac64-64f2-4589-b721-4a87a7670ca0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] <== disconnect_volume: return (308ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:55:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing instance network info cache due to event network-changed-c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] Acquiring lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] Acquired lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Refreshing network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'flavor' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-002d6eb9-afc4-4049-b477-9ea5b3a01225 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.812s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updated VIF entry in instance network info cache for port c9ffb0c1-1a87-4b11-8af8-8e69c996a711. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [{"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e1fb8768-86ad-4127-ac22-35723eb40e1c req-d40ddc27-c97c-4a1c-95bf-6ccb52dde9c4 service nova] Releasing lock "refresh_cache-fb3d20c3-8fc1-4661-9da8-d83cd6fced50" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] No waiting events found dispatching network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:50 user nova-compute[72620]: WARNING nova.compute.manager [req-d9a6a395-bd1e-49ad-a43c-e03f9de1d31d req-96bd38c5-317b-4309-84a1-1a9c5a758c9d service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received unexpected event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 for instance with vm_state building and task_state spawning.
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614550.2043793, 3d349b12-2b7a-4fc7-b045-4505a6434105 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] VM Resumed (Lifecycle Event)
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Instance spawned successfully.
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614550.205683, 3d349b12-2b7a-4fc7-b045-4505a6434105 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] VM Started (Lifecycle Event)
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Took 5.35 seconds to spawn the instance on the hypervisor.
Aug 09 20:55:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:50 user nova-compute[72620]: INFO nova.compute.manager [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Took 15.58 seconds to build instance.
Aug 09 20:55:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1de8d46-a4da-4ff8-9593-dd54de43554d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.705s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:53 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614538.0367901, 23220e25-c7e8-4419-b412-555200a63f31 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:55:53 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 23220e25-c7e8-4419-b412-555200a63f31] VM Stopped (Lifecycle Event)
Aug 09 20:55:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1e36d920-845d-4e4b-b5a2-7b9de0d1c506 None None] [instance: 23220e25-c7e8-4419-b412-555200a63f31] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:55:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:56 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:55:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing instance network info cache due to event network-changed-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] Acquiring lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] Acquired lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.network.neutron [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Refreshing network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:58 user nova-compute[72620]: INFO nova.compute.manager [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Terminating instance
Aug 09 20:55:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-unplugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] No waiting events found dispatching network-vif-unplugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bc3629f-636b-412c-a5db-f6801250a711 req-14fdcff6-603d-47bc-8ff6-13695af12dc3 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-unplugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updated VIF entry in instance network info cache for port e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [{"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b3ec6098-ac44-4576-9e6a-3f92f64474f1 req-6d3c0b1c-a08c-426d-96e9-cec948eabedc service nova] Releasing lock "refresh_cache-7b0d54ec-1ee4-498d-adb0-68f98faa4db5" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:55:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Instance destroyed successfully.
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lazy-loading 'resources' on Instance uuid 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:48:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-724924295',display_name='tempest-TestStampPattern-server-724924295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-724924295',id=19,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5fqoZyGAu7+alqgT2APu7BbGgKR1J8nMmwuAyI20CYwXUgTVF+KN5P+6UjteFSshoSXmerG0OC+Artp+uam9GCqqHF+cs5lh855OyYxRBBI2n3QMQWMY6LpMmm9u+VdQ==',key_name='tempest-TestStampPattern-1936033030',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355c9ed1b3bf41c79a2e58158b3469d6',ramdisk_id='',reservation_id='r-1e9c9ymk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1200029945',owner_user_name='tempest-TestStampPattern-1200029945-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:51:56Z,user_data=None,user_id='99eca3cb88e349c38b46fdd75ad21c69',uuid=7b0d54ec-1ee4-498d-adb0-68f98faa4db5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converting VIF {"id": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "address": "fa:16:3e:e8:13:22", "network": {"id": "c8fbe2a6-269f-469c-889b-0c834c6518e3", "bridge": "br-int", "label": "tempest-TestStampPattern-1791861906-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355c9ed1b3bf41c79a2e58158b3469d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8b9c8a3-9b", "ovs_interfaceid": "e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG os_vif [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8b9c8a3-9b, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:55:59 user nova-compute[72620]: INFO os_vif [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:13:22,bridge_name='br-int',has_traffic_filtering=True,id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f,network=Network(c8fbe2a6-269f-469c-889b-0c834c6518e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8b9c8a3-9b')
Aug 09 20:55:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Deleting instance files /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5_del
Aug 09 20:55:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Deletion of /opt/stack/data/nova/instances/7b0d54ec-1ee4-498d-adb0-68f98faa4db5_del complete
Aug 09 20:55:59 user nova-compute[72620]: INFO nova.compute.manager [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 20:55:59 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:55:59 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-e340d8e3-c85c-45ee-8066-f329af1ed90c req-4929fe8a-2953-4aef-a341-0ef19b1572de service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-deleted-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:00 user nova-compute[72620]: INFO nova.compute.manager [req-e340d8e3-c85c-45ee-8066-f329af1ed90c req-4929fe8a-2953-4aef-a341-0ef19b1572de service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Neutron deleted interface e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f; detaching it from the instance and deleting it from the info cache
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.network.neutron [req-e340d8e3-c85c-45ee-8066-f329af1ed90c req-4929fe8a-2953-4aef-a341-0ef19b1572de service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:00 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Took 0.52 seconds to deallocate network for instance.
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-e340d8e3-c85c-45ee-8066-f329af1ed90c req-4929fe8a-2953-4aef-a341-0ef19b1572de service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Detach interface failed, port_id=e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f, reason: Instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:00 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Deleted allocations for instance 7b0d54ec-1ee4-498d-adb0-68f98faa4db5
Aug 09 20:56:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-81319eca-3053-4cee-9742-2e3b1e0aaaa0 tempest-TestStampPattern-1200029945 tempest-TestStampPattern-1200029945-project-member] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] Acquiring lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] Lock "7b0d54ec-1ee4-498d-adb0-68f98faa4db5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] No waiting events found dispatching network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:01 user nova-compute[72620]: WARNING nova.compute.manager [req-759b7fc8-0584-445d-aaf8-46423685bce7 req-2c5909e2-4401-4473-8027-46535f65d574 service nova] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Received unexpected event network-vif-plugged-e8b9c8a3-9b02-4a04-90ad-a0f1eaa6a96f for instance with vm_state deleted and task_state None.
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:56:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:56:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:05 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7368MB free_disk=25.148818969726562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c5872c41-5db7-42aa-9145-108eec912a53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5cff4311-d84e-497e-a2c3-41447252fe6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:56:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:08 user nova-compute[72620]: INFO nova.compute.manager [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Attaching volume dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e to /dev/vdb
Aug 09 20:56:08 user nova-compute[72620]: DEBUG os_brick.utils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf43e3b-1b32-4a24-853b-12ddc1325a12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc40fd7-785e-4cca-9015-209eb6c90769]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1ad0ce-5176-4e4d-ad58-c40581a92033]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37ff3d7-fef9-4358-bfa0-e1f6a921816e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:56:09 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9540aae6-3857-4c43-ba49-5e5b90bee3b1]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG os_brick.utils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating existing volume attachment record: b81b81b2-7f55-4af4-a03b-9b1155f01575 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:09 user nova-compute[72620]: INFO nova.compute.manager [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Detaching volume f3519a13-8feb-4ee9-95af-7a3e5c09853b
Aug 09 20:56:09 user nova-compute[72620]: INFO nova.virt.block_device [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Attempting to driver detach volume f3519a13-8feb-4ee9-95af-7a3e5c09853b from mountpoint /dev/vdb
Aug 09 20:56:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Attempting to detach device vdb from instance bc81ba81-361a-4913-8aab-94e1849f992c from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:56:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:56:09 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:56:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:56:09 user nova-compute[72620]:   <serial>f3519a13-8feb-4ee9-95af-7a3e5c09853b</serial>
Aug 09 20:56:09 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:56:09 user nova-compute[72620]: </disk>
Aug 09 20:56:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:56:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully detached device vdb from instance bc81ba81-361a-4913-8aab-94e1849f992c from the persistent domain config.
Aug 09 20:56:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc81ba81-361a-4913-8aab-94e1849f992c from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:56:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:56:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:56:09 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:56:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:56:09 user nova-compute[72620]:   <serial>f3519a13-8feb-4ee9-95af-7a3e5c09853b</serial>
Aug 09 20:56:09 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 20:56:09 user nova-compute[72620]: </disk>
Aug 09 20:56:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:10 user nova-compute[72620]: INFO nova.compute.manager [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Terminating instance
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614570.3435724, bc81ba81-361a-4913-8aab-94e1849f992c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:56:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully detached device vdb from instance bc81ba81-361a-4913-8aab-94e1849f992c from the live domain config.
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NszPJWgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:56:10 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52a0bc-c9f9-4a00-80bc-2cb26484cd66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffafa81-0b97-4bbe-8594-7458a70dab8c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:10 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:56:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:10 user nova-compute[72620]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b (non-flash)
Aug 09 20:56:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c304d0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2509e836-0570-4dc9-a1d5-5188b233a213]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[825dfc1f-06b7-4098-acc5-9d310a86784d]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad381a4-c473-4632-afd4-e1b3faeff869]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[24923625-5813-4f8b-afcd-dd03a67aa9ac]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a036c48-9fee-4d02-9f4b-62ef75f615e9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-840e6273-607f-4457-a904-bfe20d8a091b req-2bf4e290-0334-4ea3-9df8-8fb4b81178e6 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-unplugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[907e8716-9177-4f2c-85bb-f4fc03bdbabd]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260]
Aug 09 20:56:10 user nova-compute[72620]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b, portal: 172.16.0.220,3260] successful.
Aug 09 20:56:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3519a13-8feb-4ee9-95af-7a3e5c09853b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3775571a-a2c7-4ae8-96c9-5040fdb6909b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== disconnect_volume: return (308ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:56:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:56:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Instance destroyed successfully.
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'resources' on Instance uuid c5872c41-5db7-42aa-9145-108eec912a53 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:46:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1990795843',display_name='tempest-AttachVolumeTestJSON-server-1990795843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1990795843',id=15,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhscnwCgTlvwRWr3cNZUEzJN5oIsHPjoOL6qVFE6mbibGl0PxOzASldJ2b6AjKgDvf080PexgWH6CQB9i5YrxVu3q/BWXTAFjTwE95lB4jYjUNBEgj5iDUEL3jseQXKjQ==',key_name='tempest-keypair-1250212158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-sz4er1mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=c5872c41-5db7-42aa-9145-108eec912a53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "address": "fa:16:3e:aa:60:d6", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d0fedc-a4", "ovs_interfaceid": "33d0fedc-a465-457a-959d-c054e1e8a0e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG os_vif [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33d0fedc-a4, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:56:11 user nova-compute[72620]: INFO os_vif [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:60:d6,bridge_name='br-int',has_traffic_filtering=True,id=33d0fedc-a465-457a-959d-c054e1e8a0e4,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d0fedc-a4')
Aug 09 20:56:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Deleting instance files /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53_del
Aug 09 20:56:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Deletion of /opt/stack/data/nova/instances/c5872c41-5db7-42aa-9145-108eec912a53_del complete
Aug 09 20:56:11 user nova-compute[72620]: INFO nova.compute.manager [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 20:56:11 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:56:11 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:11 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Took 0.87 seconds to deallocate network for instance.
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:12 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Deleted allocations for instance c5872c41-5db7-42aa-9145-108eec912a53
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-221d988c-9973-4317-bc5c-41c2752c2717 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "c5872c41-5db7-42aa-9145-108eec912a53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.362s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] Acquiring lock "c5872c41-5db7-42aa-9145-108eec912a53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] Lock "c5872c41-5db7-42aa-9145-108eec912a53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] No waiting events found dispatching network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:12 user nova-compute[72620]: WARNING nova.compute.manager [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received unexpected event network-vif-plugged-33d0fedc-a465-457a-959d-c054e1e8a0e4 for instance with vm_state deleted and task_state None.
Aug 09 20:56:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-c30ba761-f3d7-4419-afd0-0214e840a9c3 req-db9274ec-7a6e-467f-91b9-47b8316913b9 service nova] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Received event network-vif-deleted-33d0fedc-a465-457a-959d-c054e1e8a0e4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:14 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614559.5146391, 7b0d54ec-1ee4-498d-adb0-68f98faa4db5 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:14 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] VM Stopped (Lifecycle Event)
Aug 09 20:56:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26aa6242-72bc-4c63-9fb1-1d1316118662 None None] [instance: 7b0d54ec-1ee4-498d-adb0-68f98faa4db5] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG nova.objects.instance [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'flavor' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8812f27d-da70-4132-926f-59f7400cc1d3 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.973s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJXGvyar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:56:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:56:18 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:56:18 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33be16-e648-4888-8a88-63e96ed7a14a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:56:18 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d6044-3157-4f40-986e-c3d42857d1c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e] added
Aug 09 20:56:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae88a2-728b-43d6-8264-d18c1c746ef2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b1347-272b-42f9-80a1-37cbcfa532f6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJXGvyar {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kJXGvyar" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc1c93-e51c-4feb-b5b7-fa45a1a26105]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kJXGvyar'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a899a3b-0ea9-4574-a182-f19777f8968f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a6e601-70fa-44ae-8734-d9c3f232d75c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8c472-4214-4bed-9e21-e74306cff704]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260]
Aug 09 20:56:19 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260] successful.
Aug 09 20:56:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc350fe-37f1-4fca-9fa1-bc93c76d47f4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fcaacc-6855-4d8a-9f46-25ab2f532d87]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:19 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccf6f6-9f18-4fdc-ab57-e7dd96600010]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:56:19 user nova-compute[72620]: INFO nova.compute.claims [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Claim successful on node user
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:56:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:56:19 user nova-compute[72620]: INFO nova.virt.block_device [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Booting with volume-backed-image e5cbb687-0055-4eb1-92d5-736844e9b958 at /dev/vda
Aug 09 20:56:19 user nova-compute[72620]: DEBUG nova.policy [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f794b9e72d4443e86ada7b257af84a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f5de1122514369a2b3f71ae1146194', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJXGvyar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23637633733323635', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637633733323635', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:56:20 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:56:20 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:56:20 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:56:20 user nova-compute[72620]:   <serial>dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e</serial>
Aug 09 20:56:20 user nova-compute[72620]: </disk>
Aug 09 20:56:20 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Successfully created port: 40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] No VIF found with MAC fa:16:3e:54:23:86, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:56:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2fa74f96-6965-48d8-b44d-a470a9675461 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.979s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Successfully updated port: 40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-changed-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Refreshing instance network info cache due to event network-changed-40018e23-04bf-4343-af96-78cc24f74204. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] Acquiring lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating instance_info_cache with network_info: [{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance network_info: |[{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] Acquired lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Refreshing network info cache for port 40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:56:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:22 user nova-compute[72620]: DEBUG nova.network.neutron [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updated VIF entry in instance network info cache for port 40018e23-04bf-4343-af96-78cc24f74204. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:56:22 user nova-compute[72620]: DEBUG nova.network.neutron [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating instance_info_cache with network_info: [{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7558b66f-d24b-4cc2-af20-f3b5a96615c6 req-1fe77715-2ffe-439f-8114-301620ffd3fb service nova] Releasing lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing instance network info cache due to event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updated VIF entry in instance network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:56:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1d24e10a-97be-42fe-a1fa-6094c11f1ec6 req-4d96f37a-28db-43f8-ba4b-4a9c024b9650 service nova] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:25 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614570.9950032, c5872c41-5db7-42aa-9145-108eec912a53 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:25 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c5872c41-5db7-42aa-9145-108eec912a53] VM Stopped (Lifecycle Event)
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9b3f4104-ff29-42ed-8c95-9c0cffac8cd3 None None] [instance: c5872c41-5db7-42aa-9145-108eec912a53] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing instance network info cache due to event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:26 user nova-compute[72620]: INFO nova.compute.manager [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Rebooting instance
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updated VIF entry in instance network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bcb8876-62ba-445e-b326-38faa0126e80 req-99fe5e6c-2266-4bce-b7b4-0451b120bfaa service nova] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:56:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:27 user nova-compute[72620]: DEBUG nova.network.neutron [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:30 user nova-compute[72620]: WARNING nova.compute.manager [req-db417278-2341-48dd-8c4d-618ea96da0b0 req-b3c403de-9bc0-4e79-b945-e041c36cc8cc service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state active and task_state reboot_started.
Aug 09 20:56:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance shutdown successfully.
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.utils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04319dbc-bcfe-49c5-ac8c-ed884580f18f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67b5f0-828a-4a25-9776-4bc0a599a9b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be2061-9866-422a-ad5b-d6f3671dfa88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdbaab5-5cff-4217-b1fd-7027423b3762]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:56:30 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:56:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c4020b-ee57-4c32-997a-0fd7b13a8db9]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG os_brick.utils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:56:30 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating existing volume attachment record: e56d7366-4bd0-48a4-969b-9e415a98ea54 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:56:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:32 user nova-compute[72620]: WARNING nova.compute.manager [req-e38df66c-04a6-4b1a-b395-ffe1227c22a6 req-490a9293-a097-4a09-bb35-7dfb0f21004c service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state active and task_state reboot_started.
Aug 09 20:56:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for 5cff4311-d84e-497e-a2c3-41447252fe6b due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614594.1473303, 5cff4311-d84e-497e-a2c3-41447252fe6b => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] VM Resumed (Lifecycle Event)
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance running successfully.
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance soft rebooted successfully.
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614594.1489124, 5cff4311-d84e-497e-a2c3-41447252fe6b => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] VM Started (Lifecycle Event)
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-29846eb7-3b4c-40ae-8322-a92bceb83d0e tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.527s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:34 user nova-compute[72620]: WARNING nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state active and task_state None.
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:34 user nova-compute[72620]: WARNING nova.compute.manager [req-e78f5002-debc-4300-976e-3f26ef07b1cf req-29f248a7-6ea4-4dbe-b038-5857bcdc8f21 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state active and task_state None.
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:56:34 user nova-compute[72620]: INFO nova.compute.claims [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Claim successful on node user
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:56:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.policy [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6092876ce064105bf09fcb634e29706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8ad9263e8f54164abc4819664613850', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:56:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Creating image(s)
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "/opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "/opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "/opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.213s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk 1073741824" returned: 0 in 0.055s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Successfully created port: 8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Cannot resize image /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'migration_context' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Ensure instance console log exists: /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Successfully updated port: 8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquired lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-changed-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Refreshing instance network info cache due to event network-changed-8ced53cb-dd42-4b7e-a6eb-843f01c8175c. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] Acquiring lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.neutron [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updating instance_info_cache with network_info: [{"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Releasing lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Instance network_info: |[{"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] Acquired lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.neutron [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Refreshing network info cache for port 8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Start _get_guest_xml network_info=[{"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:56:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-476623457',display_name='tempest-VolumesSnapshotTestJSON-instance-476623457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-476623457',id=30,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0G3t9/qh7ec+tsNofVgdnc8CAdNNK0ZNb7T/BFpSJJOhT0q2selrLqN0Dvjl/cUzY6ErzFWJoZOdhLM0BE1NWn1cHNyvZfpRSYELZybcJ/8Gt2F2LPLEqXMvfkpQqFYg==',key_name='tempest-keypair-224346944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-2lkq5vq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=22335e5b-86c8-4ef3-8c65-eaf86cc59eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'pci_devices' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:56:37 user nova-compute[72620]:   <uuid>22335e5b-86c8-4ef3-8c65-eaf86cc59eb3</uuid>
Aug 09 20:56:37 user nova-compute[72620]:   <name>instance-0000001e</name>
Aug 09 20:56:37 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:56:37 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:56:37 user nova-compute[72620]:   <metadata>
Aug 09 20:56:37 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:56:37 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-476623457</nova:name>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:56:37</nova:creationTime>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:56:37 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:56:37 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:owner>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:user uuid="d6092876ce064105bf09fcb634e29706">tempest-VolumesSnapshotTestJSON-1826983670-project-member</nova:user>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:project uuid="d8ad9263e8f54164abc4819664613850">tempest-VolumesSnapshotTestJSON-1826983670</nova:project>
Aug 09 20:56:37 user nova-compute[72620]:       </nova:owner>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:56:37 user nova-compute[72620]:       <nova:ports>
Aug 09 20:56:37 user nova-compute[72620]:         <nova:port uuid="8ced53cb-dd42-4b7e-a6eb-843f01c8175c">
Aug 09 20:56:37 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 20:56:37 user nova-compute[72620]:         </nova:port>
Aug 09 20:56:37 user nova-compute[72620]:       </nova:ports>
Aug 09 20:56:37 user nova-compute[72620]:     </nova:instance>
Aug 09 20:56:37 user nova-compute[72620]:   </metadata>
Aug 09 20:56:37 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:56:37 user nova-compute[72620]:     <system>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="serial">22335e5b-86c8-4ef3-8c65-eaf86cc59eb3</entry>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="uuid">22335e5b-86c8-4ef3-8c65-eaf86cc59eb3</entry>
Aug 09 20:56:37 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:56:37 user nova-compute[72620]:     </system>
Aug 09 20:56:37 user nova-compute[72620]:   </sysinfo>
Aug 09 20:56:37 user nova-compute[72620]:   <os>
Aug 09 20:56:37 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:56:37 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:56:37 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:56:37 user nova-compute[72620]:   </os>
Aug 09 20:56:37 user nova-compute[72620]:   <features>
Aug 09 20:56:37 user nova-compute[72620]:     <acpi/>
Aug 09 20:56:37 user nova-compute[72620]:     <apic/>
Aug 09 20:56:37 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:56:37 user nova-compute[72620]:   </features>
Aug 09 20:56:37 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:56:37 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:56:37 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:56:37 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:56:37 user nova-compute[72620]:   </clock>
Aug 09 20:56:37 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:56:37 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:56:37 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:56:37 user nova-compute[72620]:   </cpu>
Aug 09 20:56:37 user nova-compute[72620]:   <devices>
Aug 09 20:56:37 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:56:37 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:56:37 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk"/>
Aug 09 20:56:37 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:56:37 user nova-compute[72620]:     </disk>
Aug 09 20:56:37 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:56:37 user nova-compute[72620]:       <mac address="fa:16:3e:d4:9e:02"/>
Aug 09 20:56:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:56:37 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:56:37 user nova-compute[72620]:       <target dev="tap8ced53cb-dd"/>
Aug 09 20:56:37 user nova-compute[72620]:     </interface>
Aug 09 20:56:37 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:56:37 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/console.log" append="off"/>
Aug 09 20:56:37 user nova-compute[72620]:     </serial>
Aug 09 20:56:37 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:56:37 user nova-compute[72620]:     <video>
Aug 09 20:56:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:56:37 user nova-compute[72620]:     </video>
Aug 09 20:56:37 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:56:37 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:56:37 user nova-compute[72620]:     </rng>
Aug 09 20:56:37 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:56:37 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:56:37 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:56:37 user nova-compute[72620]:     </memballoon>
Aug 09 20:56:37 user nova-compute[72620]:   </devices>
Aug 09 20:56:37 user nova-compute[72620]: </domain>
Aug 09 20:56:37 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-476623457',display_name='tempest-VolumesSnapshotTestJSON-instance-476623457',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-476623457',id=30,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0G3t9/qh7ec+tsNofVgdnc8CAdNNK0ZNb7T/BFpSJJOhT0q2selrLqN0Dvjl/cUzY6ErzFWJoZOdhLM0BE1NWn1cHNyvZfpRSYELZybcJ/8Gt2F2LPLEqXMvfkpQqFYg==',key_name='tempest-keypair-224346944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-2lkq5vq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:56:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=22335e5b-86c8-4ef3-8c65-eaf86cc59eb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG os_vif [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ced53cb-dd, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ced53cb-dd, col_values=(('external_ids', {'iface-id': '8ced53cb-dd42-4b7e-a6eb-843f01c8175c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:9e:02', 'vm-uuid': '22335e5b-86c8-4ef3-8c65-eaf86cc59eb3'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:56:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:37 user nova-compute[72620]: INFO os_vif [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd')
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No VIF found with MAC fa:16:3e:d4:9e:02, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:38 user nova-compute[72620]: INFO nova.compute.manager [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Terminating instance
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updated VIF entry in instance network info cache for port 8ced53cb-dd42-4b7e-a6eb-843f01c8175c. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updating instance_info_cache with network_info: [{"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c0807b54-d308-486c-8351-0628c7be4209 req-f11af461-fab7-4328-90b2-41470ccabfbf service nova] Releasing lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-3943498c-0505-4efc-bc77-5a12387512b2 req-ec7df5cd-380d-45be-92ac-fbb437793cbd service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-unplugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Instance destroyed successfully.
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.objects.instance [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid fb3d20c3-8fc1-4661-9da8-d83cd6fced50 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:49:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-660232359',display_name='tempest-ServerRescueNegativeTestJSON-server-660232359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-660232359',id=21,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABgHK6gyY32EYkTOwN0mKoh3lA+sitobdqJ6ObssRsSY/2F1LPDKENlmEerxZI+ot/4+o3MhM1R2A+ou6Jf2S5wiC8HS0dKBS48TQ3SUqPk/Nya8PRS+8Xhx1LvFI6omw==',key_name='tempest-keypair-1015569012',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-8o0ar9ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fb3d20c3-8fc1-4661-9da8-d83cd6fced50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "address": "fa:16:3e:9f:dd:ba", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9ffb0c1-1a", "ovs_interfaceid": "c9ffb0c1-1a87-4b11-8af8-8e69c996a711", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG os_vif [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9ffb0c1-1a, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: INFO os_vif [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:dd:ba,bridge_name='br-int',has_traffic_filtering=True,id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9ffb0c1-1a')
Aug 09 20:56:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Deleting instance files /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50_del
Aug 09 20:56:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Deletion of /opt/stack/data/nova/instances/fb3d20c3-8fc1-4661-9da8-d83cd6fced50_del complete
Aug 09 20:56:39 user nova-compute[72620]: INFO nova.compute.manager [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Took 1.34 seconds to destroy the instance on the hypervisor.
Aug 09 20:56:39 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:40 user nova-compute[72620]: WARNING nova.compute.manager [req-d96b5147-6ceb-4c23-aa91-6080f6ad27f1 req-89d89392-6c9c-47c1-840c-7e225124f1d7 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state building and task_state spawning.
Aug 09 20:56:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] Acquiring lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] No waiting events found dispatching network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:40 user nova-compute[72620]: WARNING nova.compute.manager [req-e85754bd-ae71-4578-93ee-1ac53fd8f802 req-e7b26444-7bd9-49ee-83f6-2b058378a427 service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received unexpected event network-vif-plugged-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 for instance with vm_state active and task_state deleting.
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-5262ebf6-0bc4-41d0-ac7b-43c403aee5cf req-bb29bd2a-2d76-4891-a7e6-147e6aee695d service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Received event network-vif-deleted-c9ffb0c1-1a87-4b11-8af8-8e69c996a711 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:40 user nova-compute[72620]: INFO nova.compute.manager [req-5262ebf6-0bc4-41d0-ac7b-43c403aee5cf req-bb29bd2a-2d76-4891-a7e6-147e6aee695d service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Neutron deleted interface c9ffb0c1-1a87-4b11-8af8-8e69c996a711; detaching it from the instance and deleting it from the info cache
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-5262ebf6-0bc4-41d0-ac7b-43c403aee5cf req-bb29bd2a-2d76-4891-a7e6-147e6aee695d service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:40 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Took 1.24 seconds to deallocate network for instance.
Aug 09 20:56:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-5262ebf6-0bc4-41d0-ac7b-43c403aee5cf req-bb29bd2a-2d76-4891-a7e6-147e6aee695d service nova] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Detach interface failed, port_id=c9ffb0c1-1a87-4b11-8af8-8e69c996a711, reason: Instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:41 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:56:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:56:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:41 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Deleted allocations for instance fb3d20c3-8fc1-4661-9da8-d83cd6fced50
Aug 09 20:56:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-77fdefa1-1cf6-4930-a297-7f692ece4caf tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fb3d20c3-8fc1-4661-9da8-d83cd6fced50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.324s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:42 user nova-compute[72620]: WARNING nova.compute.manager [req-458b19e3-2e90-419a-9a03-e287bcfc93cc req-d65ce1f8-2c34-4649-9b5e-ae622c892fec service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state building and task_state spawning.
Aug 09 20:56:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614602.3407614, 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] VM Resumed (Lifecycle Event)
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Instance spawned successfully.
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614602.342172, 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] VM Started (Lifecycle Event)
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:56:42 user nova-compute[72620]: INFO nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Took 6.94 seconds to spawn the instance on the hypervisor.
Aug 09 20:56:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:43 user nova-compute[72620]: INFO nova.compute.manager [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Took 8.19 seconds to build instance.
Aug 09 20:56:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1da3506d-cecd-4040-9fdd-37fb931cb3e3 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.330s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:56:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Creating image(s)
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Ensure instance console log exists: /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start _get_guest_xml network_info=[{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fbe8ab3e-6f7d-4820-8990-cdccac4f467f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972', 'serial': '7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'e56d7366-4bd0-48a4-969b-9e415a98ea54', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:56:47 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:47 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:56:47 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:56:47 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:56:47 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[826aa2b7-e087-498a-9d40-5d6597274fb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:56:47 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac93c0-1ee6-4559-8a8f-db2a43edd68f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972] added
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f39fa-3dd9-4beb-99a9-14e5609c60d3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6b717d-67a7-41bb-bd9c-4ee243e503ca]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwzhyMUe {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwzhyMUe" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f0b18a-e4b5-49c9-afa2-b497a663e683]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwzhyMUe'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39cb113-cc2d-46c8-951f-0b1e7022ec5e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[34869171-1283-44a5-b98f-dcdded211f03]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfeabb-9c74-49e7-98d9-cfb25545f242]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260]
Aug 09 20:56:47 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260] successful.
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef637b-5ec3-4db3-a4fa-8658ac7b2a12]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33fff31-bd3d-45b1-9dd2-bfc9dd3f15be]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:56:47 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:56:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd29e4e5-92ba-4dc4-87a9-6062315a7d06]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:56:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26138333363636664', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138333363636664', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1688400654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1688400654',id=29,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-cs6z34fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:56:20Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=fbe8ab3e-6f7d-4820-8990-cdccac4f467f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.objects.instance [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:56:48 user nova-compute[72620]:   <uuid>fbe8ab3e-6f7d-4820-8990-cdccac4f467f</uuid>
Aug 09 20:56:48 user nova-compute[72620]:   <name>instance-0000001d</name>
Aug 09 20:56:48 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:56:48 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:56:48 user nova-compute[72620]:   <metadata>
Aug 09 20:56:48 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:56:48 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1688400654</nova:name>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:56:47</nova:creationTime>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:56:48 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:56:48 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:owner>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:56:48 user nova-compute[72620]:       </nova:owner>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:56:48 user nova-compute[72620]:       <nova:ports>
Aug 09 20:56:48 user nova-compute[72620]:         <nova:port uuid="40018e23-04bf-4343-af96-78cc24f74204">
Aug 09 20:56:48 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:56:48 user nova-compute[72620]:         </nova:port>
Aug 09 20:56:48 user nova-compute[72620]:       </nova:ports>
Aug 09 20:56:48 user nova-compute[72620]:     </nova:instance>
Aug 09 20:56:48 user nova-compute[72620]:   </metadata>
Aug 09 20:56:48 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:56:48 user nova-compute[72620]:     <system>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="serial">fbe8ab3e-6f7d-4820-8990-cdccac4f467f</entry>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="uuid">fbe8ab3e-6f7d-4820-8990-cdccac4f467f</entry>
Aug 09 20:56:48 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:56:48 user nova-compute[72620]:     </system>
Aug 09 20:56:48 user nova-compute[72620]:   </sysinfo>
Aug 09 20:56:48 user nova-compute[72620]:   <os>
Aug 09 20:56:48 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:56:48 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:56:48 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:56:48 user nova-compute[72620]:   </os>
Aug 09 20:56:48 user nova-compute[72620]:   <features>
Aug 09 20:56:48 user nova-compute[72620]:     <acpi/>
Aug 09 20:56:48 user nova-compute[72620]:     <apic/>
Aug 09 20:56:48 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:56:48 user nova-compute[72620]:   </features>
Aug 09 20:56:48 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:56:48 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:56:48 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:56:48 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:56:48 user nova-compute[72620]:   </clock>
Aug 09 20:56:48 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:56:48 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:56:48 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:56:48 user nova-compute[72620]:   </cpu>
Aug 09 20:56:48 user nova-compute[72620]:   <devices>
Aug 09 20:56:48 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:56:48 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:56:48 user nova-compute[72620]:       <source dev="/dev/sde"/>
Aug 09 20:56:48 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:56:48 user nova-compute[72620]:       <serial>7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972</serial>
Aug 09 20:56:48 user nova-compute[72620]:     </disk>
Aug 09 20:56:48 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:56:48 user nova-compute[72620]:       <mac address="fa:16:3e:b0:8a:e6"/>
Aug 09 20:56:48 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:56:48 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:56:48 user nova-compute[72620]:       <target dev="tap40018e23-04"/>
Aug 09 20:56:48 user nova-compute[72620]:     </interface>
Aug 09 20:56:48 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:56:48 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/console.log" append="off"/>
Aug 09 20:56:48 user nova-compute[72620]:     </serial>
Aug 09 20:56:48 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:56:48 user nova-compute[72620]:     <video>
Aug 09 20:56:48 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:56:48 user nova-compute[72620]:     </video>
Aug 09 20:56:48 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:56:48 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:56:48 user nova-compute[72620]:     </rng>
Aug 09 20:56:48 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:56:48 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:56:48 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:56:48 user nova-compute[72620]:     </memballoon>
Aug 09 20:56:48 user nova-compute[72620]:   </devices>
Aug 09 20:56:48 user nova-compute[72620]: </domain>
Aug 09 20:56:48 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1688400654',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1688400654',id=29,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-cs6z34fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:56:20Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=fbe8ab3e-6f7d-4820-8990-cdccac4f467f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG os_vif [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40018e23-04, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap40018e23-04, col_values=(('external_ids', {'iface-id': '40018e23-04bf-4343-af96-78cc24f74204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8a:e6', 'vm-uuid': 'fbe8ab3e-6f7d-4820-8990-cdccac4f467f'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:56:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:48 user nova-compute[72620]: INFO os_vif [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04')
Aug 09 20:56:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:56:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:b0:8a:e6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:50 user nova-compute[72620]: WARNING nova.compute.manager [req-22a9ab41-42e0-4a13-970a-bc993e61e623 req-9d155ba8-649a-4324-8c48-a6eb4752add2 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state building and task_state spawning.
Aug 09 20:56:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614612.4611392, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Resumed (Lifecycle Event)
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance spawned successfully.
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614612.4640791, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Started (Lifecycle Event)
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:52 user nova-compute[72620]: INFO nova.compute.manager [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Took 33.30 seconds to build instance.
Aug 09 20:56:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-26df9cac-034f-4f7e-b6e1-1aaaaf33142a tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.396s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 20:56:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:56:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:56:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:56:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:56:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:56:53 user nova-compute[72620]: WARNING nova.compute.manager [req-d43c5d1f-768e-49e9-9a7e-2cd76c13ea2b req-865add75-562c-4c32-99f0-40f8ae5be11d service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state active and task_state None.
Aug 09 20:56:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:54 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614599.4008934, fb3d20c3-8fc1-4661-9da8-d83cd6fced50 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:56:54 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] VM Stopped (Lifecycle Event)
Aug 09 20:56:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-51ccc7af-2776-48b3-b016-95fa2ee5e5db None None] [instance: fb3d20c3-8fc1-4661-9da8-d83cd6fced50] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:56:54 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:57 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:56:58 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:56:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [{"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:56:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-df3a42a3-a50e-48d0-8962-2f77d4dea766" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:56:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:56:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:02 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:57:05 user nova-compute[72620]: INFO nova.compute.claims [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Claim successful on node user
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:57:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:57:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.policy [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7b0bb7bc6434f0b81a7479269348a72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47da24a245bc4b0e9eb5cb14adf689d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:57:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:06 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7377MB free_disk=25.163799285888672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:57:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Creating image(s)
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "/opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "/opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "/opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5cff4311-d84e-497e-a2c3-41447252fe6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk 1073741824" returned: 0 in 0.122s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Cannot resize image /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.objects.instance [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'migration_context' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Ensure instance console log exists: /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.856s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Successfully created port: 06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Successfully updated port: 06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquired lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-changed-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Refreshing instance network info cache due to event network-changed-06567e3a-9932-4546-87b9-39edc1590f97. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] Acquiring lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating instance_info_cache with network_info: [{"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Releasing lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Instance network_info: |[{"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] Acquired lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.neutron [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Refreshing network info cache for port 06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Start _get_guest_xml network_info=[{"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:57:08 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:08 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564706831',display_name='tempest-AttachVolumeTestJSON-server-1564706831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564706831',id=31,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3le8IaLcr+N/lD0xC+ENe7RBkw11yDBn4HeNoeOxxSCwfq41mAJCImVyXvwoocjCWqGIZkZaqIA7m/eBx/g2I1R3O7FZRlPG+edbuAuDUmAR/+69/dGFiesx8Pz3LF6g==',key_name='tempest-keypair-1734539562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-0k8gpy10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=97b04c22-1012-49b9-b592-a33dcd5f61e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.objects.instance [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'pci_devices' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:57:08 user nova-compute[72620]:   <uuid>97b04c22-1012-49b9-b592-a33dcd5f61e9</uuid>
Aug 09 20:57:08 user nova-compute[72620]:   <name>instance-0000001f</name>
Aug 09 20:57:08 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:57:08 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:57:08 user nova-compute[72620]:   <metadata>
Aug 09 20:57:08 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:57:08 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeTestJSON-server-1564706831</nova:name>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:57:08</nova:creationTime>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:57:08 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:57:08 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:owner>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:user uuid="e7b0bb7bc6434f0b81a7479269348a72">tempest-AttachVolumeTestJSON-12994001-project-member</nova:user>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:project uuid="47da24a245bc4b0e9eb5cb14adf689d6">tempest-AttachVolumeTestJSON-12994001</nova:project>
Aug 09 20:57:08 user nova-compute[72620]:       </nova:owner>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:57:08 user nova-compute[72620]:       <nova:ports>
Aug 09 20:57:08 user nova-compute[72620]:         <nova:port uuid="06567e3a-9932-4546-87b9-39edc1590f97">
Aug 09 20:57:08 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 20:57:08 user nova-compute[72620]:         </nova:port>
Aug 09 20:57:08 user nova-compute[72620]:       </nova:ports>
Aug 09 20:57:08 user nova-compute[72620]:     </nova:instance>
Aug 09 20:57:08 user nova-compute[72620]:   </metadata>
Aug 09 20:57:08 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:57:08 user nova-compute[72620]:     <system>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="serial">97b04c22-1012-49b9-b592-a33dcd5f61e9</entry>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="uuid">97b04c22-1012-49b9-b592-a33dcd5f61e9</entry>
Aug 09 20:57:08 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:57:08 user nova-compute[72620]:     </system>
Aug 09 20:57:08 user nova-compute[72620]:   </sysinfo>
Aug 09 20:57:08 user nova-compute[72620]:   <os>
Aug 09 20:57:08 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:57:08 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:57:08 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:57:08 user nova-compute[72620]:   </os>
Aug 09 20:57:08 user nova-compute[72620]:   <features>
Aug 09 20:57:08 user nova-compute[72620]:     <acpi/>
Aug 09 20:57:08 user nova-compute[72620]:     <apic/>
Aug 09 20:57:08 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:57:08 user nova-compute[72620]:   </features>
Aug 09 20:57:08 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:57:08 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:57:08 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:57:08 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:57:08 user nova-compute[72620]:   </clock>
Aug 09 20:57:08 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:57:08 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:57:08 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:57:08 user nova-compute[72620]:   </cpu>
Aug 09 20:57:08 user nova-compute[72620]:   <devices>
Aug 09 20:57:08 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:57:08 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:57:08 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk"/>
Aug 09 20:57:08 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:57:08 user nova-compute[72620]:     </disk>
Aug 09 20:57:08 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:57:08 user nova-compute[72620]:       <mac address="fa:16:3e:f0:09:7b"/>
Aug 09 20:57:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:57:08 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:57:08 user nova-compute[72620]:       <target dev="tap06567e3a-99"/>
Aug 09 20:57:08 user nova-compute[72620]:     </interface>
Aug 09 20:57:08 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:57:08 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/console.log" append="off"/>
Aug 09 20:57:08 user nova-compute[72620]:     </serial>
Aug 09 20:57:08 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:57:08 user nova-compute[72620]:     <video>
Aug 09 20:57:08 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:57:08 user nova-compute[72620]:     </video>
Aug 09 20:57:08 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:57:08 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:57:08 user nova-compute[72620]:     </rng>
Aug 09 20:57:08 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:57:08 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:57:08 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:57:08 user nova-compute[72620]:     </memballoon>
Aug 09 20:57:08 user nova-compute[72620]:   </devices>
Aug 09 20:57:08 user nova-compute[72620]: </domain>
Aug 09 20:57:08 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564706831',display_name='tempest-AttachVolumeTestJSON-server-1564706831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564706831',id=31,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3le8IaLcr+N/lD0xC+ENe7RBkw11yDBn4HeNoeOxxSCwfq41mAJCImVyXvwoocjCWqGIZkZaqIA7m/eBx/g2I1R3O7FZRlPG+edbuAuDUmAR/+69/dGFiesx8Pz3LF6g==',key_name='tempest-keypair-1734539562',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-0k8gpy10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=97b04c22-1012-49b9-b592-a33dcd5f61e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG os_vif [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06567e3a-99, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06567e3a-99, col_values=(('external_ids', {'iface-id': '06567e3a-9932-4546-87b9-39edc1590f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:09:7b', 'vm-uuid': '97b04c22-1012-49b9-b592-a33dcd5f61e9'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:08 user nova-compute[72620]: INFO os_vif [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99')
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:57:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No VIF found with MAC fa:16:3e:f0:09:7b, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:57:09 user nova-compute[72620]: DEBUG nova.network.neutron [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updated VIF entry in instance network info cache for port 06567e3a-9932-4546-87b9-39edc1590f97. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:57:09 user nova-compute[72620]: DEBUG nova.network.neutron [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating instance_info_cache with network_info: [{"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b4ef94bb-e5d9-415c-bace-722fa2b1fe77 req-56492efe-7963-4511-a2a2-ad00d79c24e9 service nova] Releasing lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:10 user nova-compute[72620]: WARNING nova.compute.manager [req-ae40fc55-ecd1-4d27-8d9b-f4fc7a7cb424 req-a3ef1a69-c996-45d3-b0b6-99ab5006e193 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state building and task_state spawning.
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614632.2128155, 97b04c22-1012-49b9-b592-a33dcd5f61e9 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] VM Resumed (Lifecycle Event)
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Instance spawned successfully.
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614632.2164822, 97b04c22-1012-49b9-b592-a33dcd5f61e9 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] VM Started (Lifecycle Event)
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:12 user nova-compute[72620]: INFO nova.compute.manager [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Took 7.51 seconds to build instance.
Aug 09 20:57:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-24721552-9ad2-41ee-a108-17766d5137c6 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.627s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:12 user nova-compute[72620]: WARNING nova.compute.manager [req-205dc777-cc6f-45fb-894e-6be9e98181c9 req-b14b4646-f338-49c2-af9c-4fa09e216db4 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state active and task_state None.
Aug 09 20:57:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 20:57:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 20:57:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-changed-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Refreshing instance network info cache due to event network-changed-5b4cf43f-2b26-43fc-8fe9-51d6f0014379. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] Acquiring lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] Acquired lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Refreshing network info cache for port 5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updated VIF entry in instance network info cache for port 5b4cf43f-2b26-43fc-8fe9-51d6f0014379. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating instance_info_cache with network_info: [{"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16a7e9d2-3701-4463-86b3-b2a0ec205a4b req-d098fafa-6091-4733-8cc1-5858a5b48171 service nova] Releasing lock "refresh_cache-3d349b12-2b7a-4fc7-b045-4505a6434105" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:57:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:57:37 user nova-compute[72620]: INFO nova.compute.claims [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Claim successful on node user
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 20:57:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:57:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:57:38 user nova-compute[72620]: INFO nova.virt.block_device [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Booting with volume snapshot edfd4a66-9c66-468e-96ee-ec4004af92b5 at /dev/vda
Aug 09 20:57:38 user nova-compute[72620]: DEBUG nova.policy [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:57:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Successfully created port: 9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Successfully updated port: 9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-changed-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Refreshing instance network info cache due to event network-changed-9199219e-f820-4862-8434-fb507c9a3f8a. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] Acquiring lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updating instance_info_cache with network_info: [{"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Instance network_info: |[{"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] Acquired lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:57:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Refreshing network info cache for port 9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.network.neutron [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updated VIF entry in instance network info cache for port 9199219e-f820-4862-8434-fb507c9a3f8a. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.network.neutron [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updating instance_info_cache with network_info: [{"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-76636232-b034-40ab-bb5c-5db872c06c9b req-9b0c7ab2-8b74-49bd-bc8a-1108341cc466 service nova] Releasing lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:41 user nova-compute[72620]: INFO nova.compute.manager [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Terminating instance
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f26604ea-9682-451f-8849-fc62d6d4f9f8 req-d98fba0a-f727-4eb6-ada4-d9bc66ef4659 service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-unplugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Instance destroyed successfully.
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid fd67d539-7cdf-4abc-a32e-d98f6be67e1b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-355704383',display_name='tempest-ServerRescueNegativeTestJSON-server-355704383',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-355704383',id=2,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-msw2d2fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:43:19Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=fd67d539-7cdf-4abc-a32e-d98f6be67e1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "46aca639-e25b-4982-962c-e0999eab9bc5", "address": "fa:16:3e:4d:e8:4e", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46aca639-e2", "ovs_interfaceid": "46aca639-e25b-4982-962c-e0999eab9bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG os_vif [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46aca639-e2, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:57:42 user nova-compute[72620]: INFO os_vif [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:e8:4e,bridge_name='br-int',has_traffic_filtering=True,id=46aca639-e25b-4982-962c-e0999eab9bc5,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46aca639-e2')
Aug 09 20:57:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Deleting instance files /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b_del
Aug 09 20:57:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Deletion of /opt/stack/data/nova/instances/fd67d539-7cdf-4abc-a32e-d98f6be67e1b_del complete
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: INFO nova.compute.manager [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 09 20:57:42 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:57:43 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Took 0.65 seconds to deallocate network for instance.
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-242e5615-d987-4ddf-8d77-525abb82bc2b req-e38f55d5-2020-4951-a284-e20be4d222aa service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-deleted-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Deleted allocations for instance fd67d539-7cdf-4abc-a32e-d98f6be67e1b
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-899d506d-ed5c-45fa-b8b3-ef61c03484e9 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:43 user nova-compute[72620]: WARNING nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state deleted and task_state None.
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:43 user nova-compute[72620]: WARNING nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state deleted and task_state None.
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:43 user nova-compute[72620]: WARNING nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state deleted and task_state None.
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Acquiring lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] Lock "fd67d539-7cdf-4abc-a32e-d98f6be67e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] No waiting events found dispatching network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:43 user nova-compute[72620]: WARNING nova.compute.manager [req-b6749e52-c0bf-46c2-821c-ccc42f0f1c6f req-4793d498-65e7-4cf5-8543-d91b8c462b7d service nova] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Received unexpected event network-vif-plugged-46aca639-e25b-4982-962c-e0999eab9bc5 for instance with vm_state deleted and task_state None.
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.utils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ac389-5748-41c6-8ac1-3759e7448039]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[632ca04a-0ce7-48ee-bce5-d114876edd4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2472b01-4677-4c9f-9f1f-479c319017f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470c14c-ae1a-4bcb-bff5-b45e5a22a158]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:57:44 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:57:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec3247-78e3-42f2-a899-f97081238dd3]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG os_brick.utils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:57:44 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updating existing volume attachment record: 179ba577-8247-47d2-8cae-44368434f98f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:57:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:57:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:57:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Creating image(s)
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Ensure instance console log exists: /opt/stack/data/nova/instances/ed30c83d-30a4-40e0-9850-012284c06317/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Start _get_guest_xml network_info=[{"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T20:57:28Z,direct_url=<?>,disk_format='qcow2',id=09f2d369-649b-4b40-8daf-c1a78684336c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-829423838',owner='b81cadeef3dc4103a9cb724cb24ea671',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T20:57:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuHcUNtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed30c83d-30a4-40e0-9850-012284c06317', 'attached_at': '', 'detached_at': '', 'volume_id': '32b7633c-e581-4077-b1b4-d49293e6246c', 'serial': '32b7633c-e581-4077-b1b4-d49293e6246c'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '179ba577-8247-47d2-8cae-44368434f98f', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:57:53 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:53 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-09T20:57:28Z,direct_url=<?>,disk_format='qcow2',id=09f2d369-649b-4b40-8daf-c1a78684336c,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-829423838',owner='b81cadeef3dc4103a9cb724cb24ea671',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-09T20:57:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuHcUNtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:57:53 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:57:53 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:57:53 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231731a-e80a-4f37-9959-2d69c1e17e85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:57:53 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ec191-299d-4d37-ba19-9fb5472eebe0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c] added
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4c4933-ac07-4975-a5eb-5bcf5def9d25]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e806f-ad8b-4174-b5a5-357d26bcf0b0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuHcUNtM {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RuHcUNtM" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c161aeb-5958-4395-8c70-57a8b721d158]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RuHcUNtM'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb184807-3515-4169-aead-41eb7bfa1114]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8215c3c6-52d1-4c9c-95ef-3e755bb87c63]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b1fd2-ae64-4a36-a7db-fac26afffd9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260]
Aug 09 20:57:53 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260] successful.
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327fce8-571e-4b34-b127-3bbc65f53f81]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf828da-c987-49fe-8bde-8d1f3f22ba89]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:57:53 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:57:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[94836a35-338f-4cc3-9fde-8fb038bb3ca3]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:57:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuHcUNtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23964346639396632', 'path': '/dev/sdf'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964346639396632', 'path': '/dev/sdf'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1159825049',id=32,image_ref='09f2d369-649b-4b40-8daf-c1a78684336c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP0t1IAT7RmTIl6fHdGESz0kcX+lhSbWhheRC/KopESoVTFe+ZA83DSgZF4HQzgffHbo1zhaVQMXfvZjGHY7P/e0N+ksZ5LFiM1pP1Kq9XNrPo6+vctIbqeJPHXPO714w==',key_name='tempest-keypair-432194948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-dztwaj3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2025401623',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=ed30c83d-30a4-40e0-9850-012284c06317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid ed30c83d-30a4-40e0-9850-012284c06317 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:57:54 user nova-compute[72620]:   <uuid>ed30c83d-30a4-40e0-9850-012284c06317</uuid>
Aug 09 20:57:54 user nova-compute[72620]:   <name>instance-00000020</name>
Aug 09 20:57:54 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:57:54 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:57:54 user nova-compute[72620]:   <metadata>
Aug 09 20:57:54 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:57:54 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1159825049</nova:name>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:57:53</nova:creationTime>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:57:54 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:57:54 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:owner>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 20:57:54 user nova-compute[72620]:       </nova:owner>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:root type="image" uuid="09f2d369-649b-4b40-8daf-c1a78684336c"/>
Aug 09 20:57:54 user nova-compute[72620]:       <nova:ports>
Aug 09 20:57:54 user nova-compute[72620]:         <nova:port uuid="9199219e-f820-4862-8434-fb507c9a3f8a">
Aug 09 20:57:54 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 20:57:54 user nova-compute[72620]:         </nova:port>
Aug 09 20:57:54 user nova-compute[72620]:       </nova:ports>
Aug 09 20:57:54 user nova-compute[72620]:     </nova:instance>
Aug 09 20:57:54 user nova-compute[72620]:   </metadata>
Aug 09 20:57:54 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:57:54 user nova-compute[72620]:     <system>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="serial">ed30c83d-30a4-40e0-9850-012284c06317</entry>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="uuid">ed30c83d-30a4-40e0-9850-012284c06317</entry>
Aug 09 20:57:54 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:57:54 user nova-compute[72620]:     </system>
Aug 09 20:57:54 user nova-compute[72620]:   </sysinfo>
Aug 09 20:57:54 user nova-compute[72620]:   <os>
Aug 09 20:57:54 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:57:54 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:57:54 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:57:54 user nova-compute[72620]:   </os>
Aug 09 20:57:54 user nova-compute[72620]:   <features>
Aug 09 20:57:54 user nova-compute[72620]:     <acpi/>
Aug 09 20:57:54 user nova-compute[72620]:     <apic/>
Aug 09 20:57:54 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:57:54 user nova-compute[72620]:   </features>
Aug 09 20:57:54 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:57:54 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:57:54 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:57:54 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:57:54 user nova-compute[72620]:   </clock>
Aug 09 20:57:54 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:57:54 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:57:54 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:57:54 user nova-compute[72620]:   </cpu>
Aug 09 20:57:54 user nova-compute[72620]:   <devices>
Aug 09 20:57:54 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:57:54 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:57:54 user nova-compute[72620]:       <source dev="/dev/sdf"/>
Aug 09 20:57:54 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:57:54 user nova-compute[72620]:       <serial>32b7633c-e581-4077-b1b4-d49293e6246c</serial>
Aug 09 20:57:54 user nova-compute[72620]:     </disk>
Aug 09 20:57:54 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:57:54 user nova-compute[72620]:       <mac address="fa:16:3e:44:e2:85"/>
Aug 09 20:57:54 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:57:54 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:57:54 user nova-compute[72620]:       <target dev="tap9199219e-f8"/>
Aug 09 20:57:54 user nova-compute[72620]:     </interface>
Aug 09 20:57:54 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:57:54 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/ed30c83d-30a4-40e0-9850-012284c06317/console.log" append="off"/>
Aug 09 20:57:54 user nova-compute[72620]:     </serial>
Aug 09 20:57:54 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:57:54 user nova-compute[72620]:     <video>
Aug 09 20:57:54 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:57:54 user nova-compute[72620]:     </video>
Aug 09 20:57:54 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:57:54 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:57:54 user nova-compute[72620]:     </rng>
Aug 09 20:57:54 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:57:54 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:57:54 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:57:54 user nova-compute[72620]:     </memballoon>
Aug 09 20:57:54 user nova-compute[72620]:   </devices>
Aug 09 20:57:54 user nova-compute[72620]: </domain>
Aug 09 20:57:54 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1159825049',id=32,image_ref='09f2d369-649b-4b40-8daf-c1a78684336c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP0t1IAT7RmTIl6fHdGESz0kcX+lhSbWhheRC/KopESoVTFe+ZA83DSgZF4HQzgffHbo1zhaVQMXfvZjGHY7P/e0N+ksZ5LFiM1pP1Kq9XNrPo6+vctIbqeJPHXPO714w==',key_name='tempest-keypair-432194948',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-dztwaj3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2025401623',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=ed30c83d-30a4-40e0-9850-012284c06317,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG os_vif [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9199219e-f8, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9199219e-f8, col_values=(('external_ids', {'iface-id': '9199219e-f820-4862-8434-fb507c9a3f8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e2:85', 'vm-uuid': 'ed30c83d-30a4-40e0-9850-012284c06317'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:54 user nova-compute[72620]: INFO os_vif [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8')
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:57:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:44:e2:85, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] No waiting events found dispatching network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:56 user nova-compute[72620]: WARNING nova.compute.manager [req-91cc359d-952a-48e7-a170-6bf78a63227f req-4d6b947d-6225-4116-bdfd-2400c56f28b8 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received unexpected event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a for instance with vm_state building and task_state spawning.
Aug 09 20:57:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:57 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614662.4425585, fd67d539-7cdf-4abc-a32e-d98f6be67e1b => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:57:57 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] VM Stopped (Lifecycle Event)
Aug 09 20:57:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-64cb03f5-a675-4845-a576-134247ffc82c None None] [instance: fd67d539-7cdf-4abc-a32e-d98f6be67e1b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614678.2250922, ed30c83d-30a4-40e0-9850-012284c06317 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] VM Resumed (Lifecycle Event)
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Instance spawned successfully.
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614678.2263644, ed30c83d-30a4-40e0-9850-012284c06317 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] VM Started (Lifecycle Event)
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:57:58 user nova-compute[72620]: INFO nova.compute.manager [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Took 20.92 seconds to build instance.
Aug 09 20:57:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3cd61a17-9138-40aa-99a2-71c4fd48c05d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.067s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:57:58 user nova-compute[72620]: DEBUG nova.compute.manager [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] No waiting events found dispatching network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:57:58 user nova-compute[72620]: WARNING nova.compute.manager [req-c48107ae-d906-436f-a4ab-9935bd729933 req-9fe97fc0-e7c8-4be6-ab70-496308a6837b service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received unexpected event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a for instance with vm_state active and task_state None.
Aug 09 20:57:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:57:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:57:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:58:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:58:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 3d349b12-2b7a-4fc7-b045-4505a6434105 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid ed30c83d-30a4-40e0-9850-012284c06317 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "ed30c83d-30a4-40e0-9850-012284c06317" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "ed30c83d-30a4-40e0-9850-012284c06317" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:04 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:58:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:58:07 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:07 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7317MB free_disk=25.157970428466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance df3a42a3-a50e-48d0-8962-2f77d4dea766 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5cff4311-d84e-497e-a2c3-41447252fe6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance ed30c83d-30a4-40e0-9850-012284c06317 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:58:07 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:58:08 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:58:08 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:58:08 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:58:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:58:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:58:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:58:10 user nova-compute[72620]: INFO nova.compute.manager [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Rescuing
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:58:10 user nova-compute[72620]: INFO nova.compute.claims [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Claim successful on node user
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating instance_info_cache with network_info: [{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:58:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:10 user nova-compute[72620]: DEBUG nova.policy [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1546466d62a6410c83fa85f1b0c8b934', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ded0dc696e4bd6b25a57202b956d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:58:10 user nova-compute[72620]: INFO nova.virt.block_device [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Booting with volume fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc at /dev/vda
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.utils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[41403c6c-4ab0-4098-8c07-8ed6111aff47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73939f-97ca-4410-9e30-05f10634d1ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e012ea-9bcf-4c61-b0bb-6ad84c8ebe75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ab096-d6ac-44a0-821d-e9d404458217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:58:11 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfbbce3-8e38-45a6-b120-c0b1dc4e1f5c]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG os_brick.utils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating existing volume attachment record: 9e181523-3c89-4096-91b4-7c0bdac8a621 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:11 user nova-compute[72620]: WARNING nova.compute.manager [req-f10e7e7d-a111-4244-9245-ded3fa7ac07c req-ff14a476-bf95-476b-b588-727d84b98167 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state active and task_state rescuing.
Aug 09 20:58:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance destroyed successfully.
Aug 09 20:58:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Attempting a stable device rescue
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72620) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 20:58:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Creating image(s)
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Successfully created port: 3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.part --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.images [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] c90990fc-2e06-4a56-9118-bbc5bffcd455 was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.part /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.part /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.converted" returned: 0 in 0.365s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.820s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Successfully updated port: 3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648 --force-share --output=json" returned: 0 in 0.174s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648,backing_fmt=raw /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:13 user nova-compute[72620]: WARNING nova.compute.manager [req-4029584e-71d5-4985-a6db-0fa0a6399997 req-83720895-c61e-43f9-bde4-44f4384b4c05 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state active and task_state rescuing.
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648,backing_fmt=raw /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue" returned: 0 in 0.065s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "976c341de3f9a1fba54c7a7bee62eabfc528a648" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'migration_context' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start _get_guest_xml network_info=[{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:b0:8a:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c90990fc-2e06-4a56-9118-bbc5bffcd455', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fbe8ab3e-6f7d-4820-8990-cdccac4f467f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972', 'serial': '7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'e56d7366-4bd0-48a4-969b-9e415a98ea54', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'numa_topology' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:13 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:13 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:58:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:14 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:14 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:14 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[df932fc1-e794-40aa-a6e1-53f580f9f55a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QwzhyMUe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 09 20:58:14 user nova-compute[72620]: node.name = iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972
Aug 09 20:58:14 user nova-compute[72620]: node.tpgt = -1
Aug 09 20:58:14 user nova-compute[72620]: node.startup = automatic
Aug 09 20:58:14 user nova-compute[72620]: node.leading_login = No
Aug 09 20:58:14 user nova-compute[72620]: iface.iscsi_ifacename = default
Aug 09 20:58:14 user nova-compute[72620]: iface.net_ifacename = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.ipaddress = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.prefix_len = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.hwaddress = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.transport_name = tcp
Aug 09 20:58:14 user nova-compute[72620]: iface.initiatorname = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.vlan_id = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.vlan_priority = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.vlan_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.iface_num = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.mtu = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.port = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.bootproto = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.subnet_mask = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.gateway = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_alt_client_id_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_alt_client_id = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_dns = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_learn_iqn = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_req_vendor_id_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_vendor_id_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_vendor_id = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.dhcp_slp_da = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.fragmentation = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.gratuitous_arp = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.incoming_forwarding = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.tos_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.tos = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.ttl = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.delayed_ack = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.tcp_nagle = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.tcp_wsf_state = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.tcp_wsf = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.tcp_timer_scale = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.tcp_timestamp = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.redirect = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.def_task_mgmt_timeout = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.header_digest = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.data_digest = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.immediate_data = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.initial_r2t = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.data_seq_inorder = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.data_pdu_inorder = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.erl = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.max_receive_data_len = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.first_burst_len = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.max_outstanding_r2t = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.max_burst_len = 0
Aug 09 20:58:14 user nova-compute[72620]: iface.chap_auth = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.bidi_chap = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.strict_login_compliance = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.discovery_auth = <empty>
Aug 09 20:58:14 user nova-compute[72620]: iface.discovery_logout = <empty>
Aug 09 20:58:14 user nova-compute[72620]: node.discovery_address = <empty>
Aug 09 20:58:14 user nova-compute[72620]: node.discovery_port = 0
Aug 09 20:58:14 user nova-compute[72620]: node.discovery_type = static
Aug 09 20:58:14 user nova-compute[72620]: node.session.initial_cmdsn = 0
Aug 09 20:58:14 user nova-compute[72620]: node.session.initial_login_retry_max = 8
Aug 09 20:58:14 user nova-compute[72620]: node.session.xmit_thread_priority = -20
Aug 09 20:58:14 user nova-compute[72620]: node.session.cmds_max = 128
Aug 09 20:58:14 user nova-compute[72620]: node.session.queue_depth = 32
Aug 09 20:58:14 user nova-compute[72620]: node.session.nr_sessions = 1
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.authmethod = CHAP
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.username = QwzhyMUe
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.password = ***
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.username_in = <empty>
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.password_in = <empty>
Aug 09 20:58:14 user nova-compute[72620]: node.session.auth.chap_algs = MD5
Aug 09 20:58:14 user nova-compute[72620]: node.session.timeo.replacement_timeout = 120
Aug 09 20:58:14 user nova-compute[72620]: node.session.err_timeo.abort_timeout = 15
Aug 09 20:58:14 user nova-compute[72620]: node.session.err_timeo.lu_reset_timeout = 30
Aug 09 20:58:14 user nova-compute[72620]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 09 20:58:14 user nova-compute[72620]: node.session.err_timeo.host_reset_timeout = 60
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.FastAbort = Yes
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.InitialR2T = No
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.ImmediateData = Yes
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.FirstBurstLength = 262144
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.MaxBurstLength = 16776192
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.DefaultTime2Retain = 0
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.DefaultTime2Wait = 2
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.MaxConnections = 1
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 09 20:58:14 user nova-compute[72620]: node.session.iscsi.ERL = 0
Aug 09 20:58:14 user nova-compute[72620]: node.session.scan = manual
Aug 09 20:58:14 user nova-compute[72620]: node.session.reopen_max = 0
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].address = 172.16.0.220
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].port = 3260
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].startup = manual
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].tcp.window_size = 524288
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].tcp.type_of_service = 0
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].timeo.logout_timeout = 15
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].timeo.login_timeout = 15
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].timeo.auth_timeout = 45
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].timeo.noop_out_interval = 5
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].timeo.noop_out_timeout = 5
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.HeaderDigest = None
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.DataDigest = None
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.IFMarker = No
Aug 09 20:58:14 user nova-compute[72620]: node.conn[0].iscsi.OFMarker = No
Aug 09 20:58:14 user nova-compute[72620]: # END RECORD
Aug 09 20:58:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f13f3d-ded4-4980-9f22-e206eebc74b8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf3a25-62ea-40e8-b961-8512b81e01c2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwzhyMUe {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QwzhyMUe" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4957ba8-bfd9-4a86-a444-54c09b2b03a6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QwzhyMUe'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc4cc9f-5b9e-40db-b2d2-90d00e69ef18]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[122d3f55-4958-46a8-a85d-9fa49e8c5862]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:14 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:14 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] HCTL ('36', '0', '0', 0) found on session 37 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb35af-43f2-481c-9066-32b8cae349bc]: (4, ('0 0 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Searching for a device in session 37 and hctl ('36', '0', '0', 0) yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '26138333363636664', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138333363636664', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1688400654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1688400654',id=29,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-cs6z34fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:56:53Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=fbe8ab3e-6f7d-4820-8990-cdccac4f467f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:b0:8a:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "vif_mac": "fa:16:3e:b0:8a:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'pci_devices' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:58:14 user nova-compute[72620]:   <uuid>fbe8ab3e-6f7d-4820-8990-cdccac4f467f</uuid>
Aug 09 20:58:14 user nova-compute[72620]:   <name>instance-0000001d</name>
Aug 09 20:58:14 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:58:14 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:58:14 user nova-compute[72620]:   <metadata>
Aug 09 20:58:14 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:58:14 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1688400654</nova:name>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:58:13</nova:creationTime>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:58:14 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:58:14 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:owner>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:user uuid="1f794b9e72d4443e86ada7b257af84a3">tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member</nova:user>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:project uuid="b4f5de1122514369a2b3f71ae1146194">tempest-ServerBootFromVolumeStableRescueTest-45832372</nova:project>
Aug 09 20:58:14 user nova-compute[72620]:       </nova:owner>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:58:14 user nova-compute[72620]:       <nova:ports>
Aug 09 20:58:14 user nova-compute[72620]:         <nova:port uuid="40018e23-04bf-4343-af96-78cc24f74204">
Aug 09 20:58:14 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:58:14 user nova-compute[72620]:         </nova:port>
Aug 09 20:58:14 user nova-compute[72620]:       </nova:ports>
Aug 09 20:58:14 user nova-compute[72620]:     </nova:instance>
Aug 09 20:58:14 user nova-compute[72620]:   </metadata>
Aug 09 20:58:14 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:58:14 user nova-compute[72620]:     <system>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="serial">fbe8ab3e-6f7d-4820-8990-cdccac4f467f</entry>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="uuid">fbe8ab3e-6f7d-4820-8990-cdccac4f467f</entry>
Aug 09 20:58:14 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:58:14 user nova-compute[72620]:     </system>
Aug 09 20:58:14 user nova-compute[72620]:   </sysinfo>
Aug 09 20:58:14 user nova-compute[72620]:   <os>
Aug 09 20:58:14 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:58:14 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:58:14 user nova-compute[72620]:   </os>
Aug 09 20:58:14 user nova-compute[72620]:   <features>
Aug 09 20:58:14 user nova-compute[72620]:     <acpi/>
Aug 09 20:58:14 user nova-compute[72620]:     <apic/>
Aug 09 20:58:14 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:58:14 user nova-compute[72620]:   </features>
Aug 09 20:58:14 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:58:14 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:58:14 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:58:14 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:58:14 user nova-compute[72620]:   </clock>
Aug 09 20:58:14 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:58:14 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:58:14 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:58:14 user nova-compute[72620]:   </cpu>
Aug 09 20:58:14 user nova-compute[72620]:   <devices>
Aug 09 20:58:14 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:58:14 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:58:14 user nova-compute[72620]:       <source dev="/dev/sde"/>
Aug 09 20:58:14 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:58:14 user nova-compute[72620]:       <serial>7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972</serial>
Aug 09 20:58:14 user nova-compute[72620]:     </disk>
Aug 09 20:58:14 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:58:14 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:58:14 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue"/>
Aug 09 20:58:14 user nova-compute[72620]:       <target dev="vdb" bus="virtio"/>
Aug 09 20:58:14 user nova-compute[72620]:       <boot order="1"/>
Aug 09 20:58:14 user nova-compute[72620]:     </disk>
Aug 09 20:58:14 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:58:14 user nova-compute[72620]:       <mac address="fa:16:3e:b0:8a:e6"/>
Aug 09 20:58:14 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:58:14 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:58:14 user nova-compute[72620]:       <target dev="tap40018e23-04"/>
Aug 09 20:58:14 user nova-compute[72620]:     </interface>
Aug 09 20:58:14 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:58:14 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/console.log" append="off"/>
Aug 09 20:58:14 user nova-compute[72620]:     </serial>
Aug 09 20:58:14 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:58:14 user nova-compute[72620]:     <video>
Aug 09 20:58:14 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:58:14 user nova-compute[72620]:     </video>
Aug 09 20:58:14 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:58:14 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:58:14 user nova-compute[72620]:     </rng>
Aug 09 20:58:14 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:58:14 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:58:14 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:58:14 user nova-compute[72620]:     </memballoon>
Aug 09 20:58:14 user nova-compute[72620]:   </devices>
Aug 09 20:58:14 user nova-compute[72620]: </domain>
Aug 09 20:58:14 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:58:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance destroyed successfully.
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.network.neutron [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance network_info: |[{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] No VIF found with MAC fa:16:3e:b0:8a:e6, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:58:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-changed-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Refreshing instance network info cache due to event network-changed-3c571ba7-c628-4dda-838a-4675f8c56611. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:15 user nova-compute[72620]: DEBUG nova.network.neutron [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Refreshing network info cache for port 3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG nova.network.neutron [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updated VIF entry in instance network info cache for port 3c571ba7-c628-4dda-838a-4675f8c56611. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG nova.network.neutron [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:16 user nova-compute[72620]: WARNING nova.compute.manager [req-8eb5cdcf-c5b6-4532-beb4-095dc9e69c09 req-cd775d63-6f3b-4bb6-a66a-1a4e9f398f15 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state active and task_state rescuing.
Aug 09 20:58:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for fbe8ab3e-6f7d-4820-8990-cdccac4f467f due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614697.840452, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:58:17 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Resumed (Lifecycle Event)
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9b62dc2c-5f6d-4349-93f7-6d8dd814896f tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:58:17 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614697.8439746, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:58:17 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Started (Lifecycle Event)
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:58:17 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:17 user nova-compute[72620]: WARNING nova.compute.manager [req-a0e5e24f-a991-40d0-8971-385bd2d2bbc6 req-615be5fa-db7f-4b54-95b5-6a13e49a364c service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state rescued and task_state None.
Aug 09 20:58:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:18 user nova-compute[72620]: DEBUG nova.compute.manager [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing instance network info cache due to event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:58:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:18 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updated VIF entry in instance network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9f25d74-6e6c-4d77-be27-900405de1939 req-14937d16-9ebf-477d-8b75-b5d3e9255729 service nova] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:19 user nova-compute[72620]: INFO nova.compute.manager [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Detaching volume dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e
Aug 09 20:58:19 user nova-compute[72620]: INFO nova.virt.block_device [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Attempting to driver detach volume dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e from mountpoint /dev/vdb
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Attempting to detach device vdb from instance 5cff4311-d84e-497e-a2c3-41447252fe6b from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:58:19 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:58:19 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:58:19 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:58:19 user nova-compute[72620]:   <serial>dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e</serial>
Aug 09 20:58:19 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:58:19 user nova-compute[72620]: </disk>
Aug 09 20:58:19 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:58:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully detached device vdb from instance 5cff4311-d84e-497e-a2c3-41447252fe6b from the persistent domain config.
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cff4311-d84e-497e-a2c3-41447252fe6b from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:58:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:58:19 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:58:19 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 20:58:19 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:58:19 user nova-compute[72620]:   <serial>dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e</serial>
Aug 09 20:58:19 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:58:19 user nova-compute[72620]: </disk>
Aug 09 20:58:19 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614700.4229202, 5cff4311-d84e-497e-a2c3-41447252fe6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:58:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully detached device vdb from instance 5cff4311-d84e-497e-a2c3-41447252fe6b from the live domain config.
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kJXGvyar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb3836a-95a7-4567-9319-44848026e58d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884f770-73b7-4559-a18b-1b9a8fcf852d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3042d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba76050-a462-4af4-80b2-4bb7f26a6e3b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a70fe-c3cc-4a8a-a5d3-adb22408de3d]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23eabd8-e3ca-4701-af6d-e433d72cbdcd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f08812-825d-4c73-a663-0893cb419ec0]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:58:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Creating image(s)
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Ensure instance console log exists: /opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start _get_guest_xml network_info=[{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '66d3342a-c39e-4469-890f-3ac8934e8714', 'attached_at': '', 'detached_at': '', 'volume_id': 'fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc', 'serial': 'fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '9e181523-3c89-4096-91b4-7c0bdac8a621', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[07375d32-3327-4c79-b38a-98263455ac66]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82b1666-f423-4514-87ce-102cbc082b7b]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260]
Aug 09 20:58:20 user nova-compute[72620]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e, portal: 172.16.0.220,3260] successful.
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbeb3b1b-7aff-4930-a4da-58ead2e9bd5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6230709a-54e0-4b38-b439-3411a8ba4b28]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] <== disconnect_volume: return (334ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.073s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:20 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd053fb6-61f1-4482-a144-5bb59caf2f7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:58:20 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing instance network info cache due to event network-changed-a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] Acquiring lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] Acquired lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Refreshing network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748f859-4d2f-4748-b686-6b86a3b7eee2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc] added
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a11343-ed53-49ea-94ac-266fc82f6fcd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[88006270-cb24-4b4f-aee2-98941ddd7dda]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzXFpqWS {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzXFpqWS" returned: 0 in 0.040s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f65a3-b9c4-4118-ac70-3c6090a5e676]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzXFpqWS'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2485c-08ea-42f7-8d35-bb224d0bc06d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f67330-599d-489a-9b53-298a62417ce4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:20 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc1ef1-c367-475b-8e1d-ab69317ecf88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]
Aug 09 20:58:21 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.
Aug 09 20:58:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[734dbc0a-e752-43f0-a00a-7d304791fa9a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[43940cee-3e3f-4297-9bbc-eaffdeb8de28]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:21 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df23176-d577-4ff2-afd2-7cc926a43f42]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updated VIF entry in instance network info cache for port a16247f8-f62c-4789-896c-3fb903cc0bbf. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [{"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-00e2b290-09fb-4061-80ec-f3316bbd32bb req-c094f90e-7dc5-4963-b52e-0b26f4c67898 service nova] Releasing lock "refresh_cache-5cff4311-d84e-497e-a2c3-41447252fe6b" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG nova.objects.instance [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'flavor' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-70468a58-df76-4614-9126-15496a920025 tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26364336139303633', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364336139303633', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_devices' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:58:22 user nova-compute[72620]:   <uuid>66d3342a-c39e-4469-890f-3ac8934e8714</uuid>
Aug 09 20:58:22 user nova-compute[72620]:   <name>instance-00000021</name>
Aug 09 20:58:22 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:58:22 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:58:22 user nova-compute[72620]:   <metadata>
Aug 09 20:58:22 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:58:22 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:58:22 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherA-server-1106592924</nova:name>
Aug 09 20:58:22 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:58:20</nova:creationTime>
Aug 09 20:58:22 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:58:22 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:58:22 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:58:22 user nova-compute[72620]:       <nova:owner>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:user uuid="1546466d62a6410c83fa85f1b0c8b934">tempest-ServerActionsTestOtherA-763482691-project-member</nova:user>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:project uuid="80ded0dc696e4bd6b25a57202b956d63">tempest-ServerActionsTestOtherA-763482691</nova:project>
Aug 09 20:58:22 user nova-compute[72620]:       </nova:owner>
Aug 09 20:58:22 user nova-compute[72620]:       <nova:ports>
Aug 09 20:58:22 user nova-compute[72620]:         <nova:port uuid="3c571ba7-c628-4dda-838a-4675f8c56611">
Aug 09 20:58:22 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 20:58:22 user nova-compute[72620]:         </nova:port>
Aug 09 20:58:22 user nova-compute[72620]:       </nova:ports>
Aug 09 20:58:22 user nova-compute[72620]:     </nova:instance>
Aug 09 20:58:22 user nova-compute[72620]:   </metadata>
Aug 09 20:58:22 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:58:22 user nova-compute[72620]:     <system>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="serial">66d3342a-c39e-4469-890f-3ac8934e8714</entry>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="uuid">66d3342a-c39e-4469-890f-3ac8934e8714</entry>
Aug 09 20:58:22 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:58:22 user nova-compute[72620]:     </system>
Aug 09 20:58:22 user nova-compute[72620]:   </sysinfo>
Aug 09 20:58:22 user nova-compute[72620]:   <os>
Aug 09 20:58:22 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:58:22 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:58:22 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:58:22 user nova-compute[72620]:   </os>
Aug 09 20:58:22 user nova-compute[72620]:   <features>
Aug 09 20:58:22 user nova-compute[72620]:     <acpi/>
Aug 09 20:58:22 user nova-compute[72620]:     <apic/>
Aug 09 20:58:22 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:58:22 user nova-compute[72620]:   </features>
Aug 09 20:58:22 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:58:22 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:58:22 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:58:22 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:58:22 user nova-compute[72620]:   </clock>
Aug 09 20:58:22 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:58:22 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:58:22 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:58:22 user nova-compute[72620]:   </cpu>
Aug 09 20:58:22 user nova-compute[72620]:   <devices>
Aug 09 20:58:22 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 20:58:22 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:58:22 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 20:58:22 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:58:22 user nova-compute[72620]:       <serial>fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc</serial>
Aug 09 20:58:22 user nova-compute[72620]:     </disk>
Aug 09 20:58:22 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:58:22 user nova-compute[72620]:       <mac address="fa:16:3e:ff:99:38"/>
Aug 09 20:58:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:58:22 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:58:22 user nova-compute[72620]:       <target dev="tap3c571ba7-c6"/>
Aug 09 20:58:22 user nova-compute[72620]:     </interface>
Aug 09 20:58:22 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:58:22 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714/console.log" append="off"/>
Aug 09 20:58:22 user nova-compute[72620]:     </serial>
Aug 09 20:58:22 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:58:22 user nova-compute[72620]:     <video>
Aug 09 20:58:22 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:58:22 user nova-compute[72620]:     </video>
Aug 09 20:58:22 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:58:22 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:58:22 user nova-compute[72620]:     </rng>
Aug 09 20:58:22 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:58:22 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:58:22 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:58:22 user nova-compute[72620]:     </memballoon>
Aug 09 20:58:22 user nova-compute[72620]:   </devices>
Aug 09 20:58:22 user nova-compute[72620]: </domain>
Aug 09 20:58:22 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG os_vif [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c571ba7-c6, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c571ba7-c6, col_values=(('external_ids', {'iface-id': '3c571ba7-c628-4dda-838a-4675f8c56611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:99:38', 'vm-uuid': '66d3342a-c39e-4469-890f-3ac8934e8714'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:22 user nova-compute[72620]: INFO os_vif [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6')
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No VIF found with MAC fa:16:3e:ff:99:38, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:58:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:23 user nova-compute[72620]: WARNING nova.compute.manager [req-ed8df64b-80d4-41cb-b666-79530d56b565 req-1268619a-07fb-4dc5-a5b3-c9de422b3e5d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state building and task_state spawning.
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614705.710655, 66d3342a-c39e-4469-890f-3ac8934e8714 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Resumed (Lifecycle Event)
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance spawned successfully.
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614705.716537, 66d3342a-c39e-4469-890f-3ac8934e8714 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Started (Lifecycle Event)
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:25 user nova-compute[72620]: WARNING nova.compute.manager [req-6f7ca621-644b-4ed6-9bb7-f2823f207dfc req-e7acd857-5925-48d9-8df9-02480bad1a9a service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state building and task_state spawning.
Aug 09 20:58:25 user nova-compute[72620]: INFO nova.compute.manager [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Took 15.68 seconds to build instance.
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-66b12486-0b8b-4b7a-aca0-601ca2947088 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.773s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-changed-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Refreshing instance network info cache due to event network-changed-8ced53cb-dd42-4b7e-a6eb-843f01c8175c. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] Acquiring lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] Acquired lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Refreshing network info cache for port 8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updated VIF entry in instance network info cache for port 8ced53cb-dd42-4b7e-a6eb-843f01c8175c. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updating instance_info_cache with network_info: [{"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-66e772f3-7625-463c-919b-c0849e6120c6 req-895b6354-2635-435e-8e9d-69d1f036d127 service nova] Releasing lock "refresh_cache-22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Ignoring supplied device name: /dev/vdb
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:26 user nova-compute[72620]: INFO nova.compute.manager [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Attaching volume b2304d9b-91af-4c5f-8d53-c0c728feae82 to /dev/vdb
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.utils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f1ca4f-bde1-4f97-956a-da1017935133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211e6e2-251c-410c-96ee-b9365ad85eaf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313fb0a-8a9b-442f-ae5e-f33766a81ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2271c8a-a303-4363-8ed9-3ae7cd79f6f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:58:27 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:58:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3cfa3a-866f-4594-a6c3-a567ad9bbd17]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG os_brick.utils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updating existing volume attachment record: 2d14e775-e6de-4f65-9432-fadbc1d697cb {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:32 user nova-compute[72620]: INFO nova.compute.manager [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Terminating instance
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-4bed0473-f60b-477f-a1f7-078471c8da6d req-c3c34970-6502-4b88-9046-fed0e4cd283f service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-unplugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:58:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Instance destroyed successfully.
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lazy-loading 'resources' on Instance uuid df3a42a3-a50e-48d0-8962-2f77d4dea766 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:41:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1493500109',display_name='tempest-ServerRescueNegativeTestJSON-server-1493500109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1493500109',id=1,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='017c3a5764804c1ab1c5cde902ed6596',ramdisk_id='',reservation_id='r-rhv465p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1950348124',owner_user_name='tempest-ServerRescueNegativeTestJSON-1950348124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:48:09Z,user_data=None,user_id='a62ad594d1d64a5e9c14551b4d87e6e1',uuid=df3a42a3-a50e-48d0-8962-2f77d4dea766,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converting VIF {"id": "462bce5d-1459-44eb-8115-88087cc6ec6c", "address": "fa:16:3e:30:3a:76", "network": {"id": "27903eb7-cfc2-4e27-95f0-17adcb28bd80", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-473908121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "017c3a5764804c1ab1c5cde902ed6596", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap462bce5d-14", "ovs_interfaceid": "462bce5d-1459-44eb-8115-88087cc6ec6c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG os_vif [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap462bce5d-14, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:32 user nova-compute[72620]: INFO os_vif [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:3a:76,bridge_name='br-int',has_traffic_filtering=True,id=462bce5d-1459-44eb-8115-88087cc6ec6c,network=Network(27903eb7-cfc2-4e27-95f0-17adcb28bd80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap462bce5d-14')
Aug 09 20:58:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Deleting instance files /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766_del
Aug 09 20:58:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Deletion of /opt/stack/data/nova/instances/df3a42a3-a50e-48d0-8962-2f77d4dea766_del complete
Aug 09 20:58:33 user nova-compute[72620]: INFO nova.compute.manager [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 09 20:58:33 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:33 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Took 0.51 seconds to deallocate network for instance.
Aug 09 20:58:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:58:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:34 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Deleted allocations for instance df3a42a3-a50e-48d0-8962-2f77d4dea766
Aug 09 20:58:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6f807bca-08ad-4167-85e6-7cfdddc4e5c2 tempest-ServerRescueNegativeTestJSON-1950348124 tempest-ServerRescueNegativeTestJSON-1950348124-project-member] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.733s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] Acquiring lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:58:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:58:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] Lock "df3a42a3-a50e-48d0-8962-2f77d4dea766-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] No waiting events found dispatching network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:58:34 user nova-compute[72620]: WARNING nova.compute.manager [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received unexpected event network-vif-plugged-462bce5d-1459-44eb-8115-88087cc6ec6c for instance with vm_state deleted and task_state None.
Aug 09 20:58:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-b6372b73-df6f-405a-ac1e-477434bab1a7 req-2390b97f-d63c-4a72-9716-4ea8022fc414 service nova] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Received event network-vif-deleted-462bce5d-1459-44eb-8115-88087cc6ec6c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrZRYpnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:58:36 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:36 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:58:36 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[62533be9-9e13-4daf-9704-629487a750d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:58:36 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b957068-5756-4189-84e4-a684d812e5cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82] added
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec38b4-8bde-4977-a9a4-27f71dc0b7fd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e5177-b0d9-4394-99cb-ac59434e0403]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrZRYpnV {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrZRYpnV" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[42221fe6-f0cf-4ac3-981e-9d258337b138]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrZRYpnV'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333a1db-744a-4f09-a904-95e6f7af2f98]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d363de6-cc03-453b-9246-064fedcb9f87]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702a98b-387e-4eed-83ae-9560725d56f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260]
Aug 09 20:58:36 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260] successful.
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8df1e-d2cf-4f05-a4b7-24cef24eb42a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bfbab2-52e2-4209-a53a-75b998e322de]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:58:36 user nova-compute[72620]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)
Aug 09 20:58:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e990028-be70-47e2-b2e0-6dfe242a463c]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:58:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrZRYpnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23034626137656463', 'path': '/dev/sdg'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034626137656463', 'path': '/dev/sdg'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:58:37 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:58:37 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:58:37 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:58:37 user nova-compute[72620]:   <serial>b2304d9b-91af-4c5f-8d53-c0c728feae82</serial>
Aug 09 20:58:37 user nova-compute[72620]: </disk>
Aug 09 20:58:37 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:58:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:58:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:58:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] No VIF found with MAC fa:16:3e:d4:9e:02, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:58:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec60f74e-6dad-424a-b962-f6d31f5a5b12 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.191s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:58:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:47 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614712.9453316, df3a42a3-a50e-48d0-8962-2f77d4dea766 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:58:47 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] VM Stopped (Lifecycle Event)
Aug 09 20:58:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b755b32f-c69a-4a50-a61c-0cab20ea290f None None] [instance: df3a42a3-a50e-48d0-8962-2f77d4dea766] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:58:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-changed-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Refreshing instance network info cache due to event network-changed-06567e3a-9932-4546-87b9-39edc1590f97. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] Acquiring lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] Acquired lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Refreshing network info cache for port 06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updated VIF entry in instance network info cache for port 06567e3a-9932-4546-87b9-39edc1590f97. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating instance_info_cache with network_info: [{"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:58:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-24ac82ea-dc8e-492f-8f6c-9f34420e2630 req-62f3523d-121e-4d27-a40f-5762c8a6949c service nova] Releasing lock "refresh_cache-97b04c22-1012-49b9-b592-a33dcd5f61e9" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:58:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:58:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:00 user nova-compute[72620]: INFO nova.compute.manager [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attaching volume caa9b00f-88b9-4a9c-82ac-897be98ab1a0 to /dev/vdb
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0864ff8c-a93b-4687-881b-edeb256a9060]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e57b304-511e-460e-83d3-3d130f08a90e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbb9876-6375-46d7-8631-9f4de602638a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[250973b4-abd3-4892-ab03-104b1f088b64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:59:00 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57919d2-76b8-45c6-a702-5e651a968c09]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating existing volume attachment record: 813b951c-edf0-4a4b-a77f-e1e938da9428 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:59:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 20:59:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [{"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:59:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 20:59:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:06 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:07 user nova-compute[72620]: INFO nova.compute.manager [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Detaching volume b2304d9b-91af-4c5f-8d53-c0c728feae82
Aug 09 20:59:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:07 user nova-compute[72620]: INFO nova.virt.block_device [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Attempting to driver detach volume b2304d9b-91af-4c5f-8d53-c0c728feae82 from mountpoint /dev/vdb
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Attempting to detach device vdb from instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:07 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:07 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:59:07 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:59:07 user nova-compute[72620]:   <serial>b2304d9b-91af-4c5f-8d53-c0c728feae82</serial>
Aug 09 20:59:07 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:59:07 user nova-compute[72620]: </disk>
Aug 09 20:59:07 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:07 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully detached device vdb from instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 from the persistent domain config.
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:07 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:07 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:59:07 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:59:07 user nova-compute[72620]:   <serial>b2304d9b-91af-4c5f-8d53-c0c728feae82</serial>
Aug 09 20:59:07 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:59:07 user nova-compute[72620]: </disk>
Aug 09 20:59:07 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue --force-share --output=json" returned: 0 in 0.261s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614748.04239, 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:59:08 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully detached device vdb from instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 from the live domain config.
Aug 09 20:59:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrZRYpnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:08 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[242df0a8-0b23-4c34-b01f-367874ce7ed2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b61f38d-aa49-4ac1-a8f3-4a49a94b0a32]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)
Aug 09 20:59:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:08 user nova-compute[72620]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 (non-flash)
Aug 09 20:59:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d283ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82'): ({'sdg'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Removing single pathed devices sdg {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd930db6-6e1a-47c1-98e7-3fce9e2a43c4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb77bd6-a50e-425a-b041-05190b62d1e2]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Flushing IO for device /dev/sdg {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11467b5-ae5e-4809-957d-891811e59902]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a334ceb7-b62c-4578-960f-0d9631579f29]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5095923-f549-470a-b67b-e18541f830dd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be3bd2-d844-44e1-9134-3d2751efcc3a]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260]
Aug 09 20:59:08 user nova-compute[72620]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0fa707-f2c7-41cb-975d-902a0b136384]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== disconnect_volume: return (351ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'flavor' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-730e19d0-5fa8-49a3-9c3d-730ad701f2e4 tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.842s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.772s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:09 user nova-compute[72620]: INFO nova.compute.manager [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Terminating instance
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.compute.manager [req-9443a3a9-cb6e-449e-b319-a55554a14bfb req-b3dce7e5-8633-488b-8000-fddedf28a9b4 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnZBwsqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:09 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:09 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:09 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:59:09 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:59:09 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:59:09 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=25.078990936279297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5200ab-296f-41e3-b99c-32483e3a05f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:59:09 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d643f5-ae55-44ec-a32b-a884780efc90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0] added
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299291b-707b-4a31-a286-1d5f6c5867fb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Instance destroyed successfully.
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lazy-loading 'resources' on Instance uuid 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-476623457',display_name='tempest-VolumesSnapshotTestJSON-instance-476623457',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-476623457',id=30,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0G3t9/qh7ec+tsNofVgdnc8CAdNNK0ZNb7T/BFpSJJOhT0q2selrLqN0Dvjl/cUzY6ErzFWJoZOdhLM0BE1NWn1cHNyvZfpRSYELZybcJ/8Gt2F2LPLEqXMvfkpQqFYg==',key_name='tempest-keypair-224346944',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8ad9263e8f54164abc4819664613850',ramdisk_id='',reservation_id='r-2lkq5vq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1826983670',owner_user_name='tempest-VolumesSnapshotTestJSON-1826983670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:56:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6092876ce064105bf09fcb634e29706',uuid=22335e5b-86c8-4ef3-8c65-eaf86cc59eb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converting VIF {"id": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "address": "fa:16:3e:d4:9e:02", "network": {"id": "6e92fae0-79ff-462c-90a3-8d331b2c0530", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1681942247-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8ad9263e8f54164abc4819664613850", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ced53cb-dd", "ovs_interfaceid": "8ced53cb-dd42-4b7e-a6eb-843f01c8175c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_vif [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b379ff-e00b-43ca-be6e-1e58c10e8339]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ced53cb-dd, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnZBwsqi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:59:10 user nova-compute[72620]: INFO os_vif [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:9e:02,bridge_name='br-int',has_traffic_filtering=True,id=8ced53cb-dd42-4b7e-a6eb-843f01c8175c,network=Network(6e92fae0-79ff-462c-90a3-8d331b2c0530),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ced53cb-dd')
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrZRYpnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:10 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5cff4311-d84e-497e-a2c3-41447252fe6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance ed30c83d-30a4-40e0-9850-012284c06317 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CnZBwsqi" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2e3cde-c2eb-4579-a298-3f03ba5bf108]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CnZBwsqi'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6adae57-9e1c-40ed-9d86-5c23370d71df]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d06672-197e-48f6-99f2-3a54b934d438]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec1eb4-9125-428b-b978-1d7ff8173e1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260]
Aug 09 20:59:10 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c752dfa4-6159-4bfd-bcfd-aef8b3e17d33]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8199aa-9fb4-4550-827a-968a104d344b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:10 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[56472515-7f9a-48dd-8923-8825430d6277]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnZBwsqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23063376437643230', 'path': '/dev/sdg'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063376437643230', 'path': '/dev/sdg'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.290s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2304d9b-91af-4c5f-8d53-c0c728feae82', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[078d666a-99b4-4682-9dbf-113dcc3a8837]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:59:11 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:11 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:59:11 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:59:11 user nova-compute[72620]:   <serial>caa9b00f-88b9-4a9c-82ac-897be98ab1a0</serial>
Aug 09 20:59:11 user nova-compute[72620]: </disk>
Aug 09 20:59:11 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0462cc-428f-4b0b-b1d1-758b84bb5be6]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:11 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:11 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:11 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30466440>, {}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Disconnecting from: [] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] <== disconnect_volume: return (1350ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:59:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Deleting instance files /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3_del
Aug 09 20:59:11 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Deletion of /opt/stack/data/nova/instances/22335e5b-86c8-4ef3-8c65-eaf86cc59eb3_del complete
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 20:59:11 user nova-compute[72620]: INFO nova.compute.manager [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Took 2.24 seconds to destroy the instance on the hypervisor.
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:11 user nova-compute[72620]: WARNING nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state active and task_state deleting.
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:11 user nova-compute[72620]: WARNING nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state active and task_state deleting.
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:11 user nova-compute[72620]: WARNING nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state active and task_state deleting.
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-unplugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Acquiring lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] No waiting events found dispatching network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:11 user nova-compute[72620]: WARNING nova.compute.manager [req-642abca2-b1c8-4193-91dd-1af7e0de6076 req-39008dc9-9322-4813-8232-a8f89df7cc64 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received unexpected event network-vif-plugged-8ced53cb-dd42-4b7e-a6eb-843f01c8175c for instance with vm_state active and task_state deleting.
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No VIF found with MAC fa:16:3e:f0:09:7b, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:59:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b808944c-4d40-4afb-8ecd-719c8855ae5f tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.774s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:12 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Took 0.95 seconds to deallocate network for instance.
Aug 09 20:59:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-5fa1434e-7429-4384-855f-f7c96b0042f3 req-b1b07540-cb6a-4e1e-893a-7c67ae20a3f1 service nova] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Received event network-vif-deleted-8ced53cb-dd42-4b7e-a6eb-843f01c8175c {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:12 user nova-compute[72620]: WARNING nova.volume.cinder [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Attachment 2d14e775-e6de-4f65-9432-fadbc1d697cb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2d14e775-e6de-4f65-9432-fadbc1d697cb. (HTTP 404) (Request-ID: req-e74be2dc-c926-45fb-9886-5b208930b779)
Aug 09 20:59:12 user nova-compute[72620]: INFO nova.compute.manager [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Took 0.03 seconds to detach 1 volumes for instance.
Aug 09 20:59:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:12 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:13 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Deleted allocations for instance 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3
Aug 09 20:59:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d3dafbe6-5630-4010-b982-0f5cd3dcda9d tempest-VolumesSnapshotTestJSON-1826983670 tempest-VolumesSnapshotTestJSON-1826983670-project-member] Lock "22335e5b-86c8-4ef3-8c65-eaf86cc59eb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.847s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:15 user nova-compute[72620]: INFO nova.compute.manager [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Terminating instance
Aug 09 20:59:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG nova.objects.instance [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-95f0286e-d82a-48f0-b003-ce366d6223aa req-562802b6-bec8-4145-870a-520d3bc54b40 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-unplugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:59:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:16 user nova-compute[72620]: INFO nova.compute.manager [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attaching volume 95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc to /dev/vdc
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.utils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee69b8-e903-4954-bf1a-6ad2fa2d4ecf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[658336bf-81aa-477c-bcdf-f22036c78da6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94fc0ff-d608-402e-92bd-96abb49dade4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[237db541-3a6a-4afe-a40a-158aca061c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 20:59:16 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9373737-1f7d-4d0d-b84e-37b4bb115b74]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_brick.utils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating existing volume attachment record: 1a976943-4055-4930-951c-8472e483022c {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Instance destroyed successfully.
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lazy-loading 'resources' on Instance uuid 5cff4311-d84e-497e-a2c3-41447252fe6b {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-186225411',display_name='tempest-TestMinimumBasicScenario-server-186225411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-186225411',id=27,image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB6s+8X0h1wXo7OtEUCp/JOUf/76fcMWk+/+jkw2WC+i+Pd66x0PpEF9jVjC77yx3taj9lAEexJqfVr+Jdlx+Ro5tDH5x71Vsxn7SSeAu57T65Pgrwo+7YszilVOkpsQ5g==',key_name='tempest-TestMinimumBasicScenario-769244683',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4fe04d8fa9624440a7e46af39c41a498',ramdisk_id='',reservation_id='r-on7w08zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e07d40c3-6f45-4507-8d04-c1ca164c4384',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-931784319',owner_user_name='tempest-TestMinimumBasicScenario-931784319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:56:34Z,user_data=None,user_id='93ec7531ffb048959bb3d9e47eba8485',uuid=5cff4311-d84e-497e-a2c3-41447252fe6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converting VIF {"id": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "address": "fa:16:3e:54:23:86", "network": {"id": "e99dacf8-5037-4f13-9732-2805d4b1b321", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-608924888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4fe04d8fa9624440a7e46af39c41a498", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa16247f8-f6", "ovs_interfaceid": "a16247f8-f62c-4789-896c-3fb903cc0bbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG os_vif [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa16247f8-f6, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:59:16 user nova-compute[72620]: INFO os_vif [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:23:86,bridge_name='br-int',has_traffic_filtering=True,id=a16247f8-f62c-4789-896c-3fb903cc0bbf,network=Network(e99dacf8-5037-4f13-9732-2805d4b1b321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa16247f8-f6')
Aug 09 20:59:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Deleting instance files /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b_del
Aug 09 20:59:16 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Deletion of /opt/stack/data/nova/instances/5cff4311-d84e-497e-a2c3-41447252fe6b_del complete
Aug 09 20:59:16 user nova-compute[72620]: INFO nova.compute.manager [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 20:59:16 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:59:16 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:17 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Took 0.53 seconds to deallocate network for instance.
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:17 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Deleted allocations for instance 5cff4311-d84e-497e-a2c3-41447252fe6b
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be0cf515-14f3-4ef5-b12e-94496433685b tempest-TestMinimumBasicScenario-931784319 tempest-TestMinimumBasicScenario-931784319-project-member] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] Acquiring lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] Lock "5cff4311-d84e-497e-a2c3-41447252fe6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] No waiting events found dispatching network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:17 user nova-compute[72620]: WARNING nova.compute.manager [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received unexpected event network-vif-plugged-a16247f8-f62c-4789-896c-3fb903cc0bbf for instance with vm_state deleted and task_state None.
Aug 09 20:59:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8ee95c3a-dd7e-4880-bf17-818b81445173 req-446fc80e-3963-402f-b876-0dca9a4e4af4 service nova] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Received event network-vif-deleted-a16247f8-f62c-4789-896c-3fb903cc0bbf {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614750.06437, 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:25 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] VM Stopped (Lifecycle Event)
Aug 09 20:59:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-4f92b98b-1717-4df6-83b7-028717585d4a None None] [instance: 22335e5b-86c8-4ef3-8c65-eaf86cc59eb3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdMfVAjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:25 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19d3cb3-a006-4a19-8408-902dd080f330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 20:59:25 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6489c4a-c9a8-48fb-853e-1eff37222fd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc] added
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc04be0-a57a-4756-8433-5e64e2501f0a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6c398-4aa8-4306-8ed4-9739662406f4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdMfVAjL {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdMfVAjL" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e353bd5-ea00-4219-bd29-017c81372a26]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdMfVAjL'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1dfbc1-5137-40bd-9352-4f451aa1aa95]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e3a15-015e-4da4-8b63-4e0681cd8191]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eb4812-3632-4c30-8137-867489888da6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260]
Aug 09 20:59:25 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bed95-d36d-4d72-87d5-0fa5579fd52d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecf704f-4881-4817-8634-648f6d71ffb2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:25 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] HCTL ('39', '-', '-', 0) found on session 42 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f334b9-eec3-4979-8826-5d148c2da340]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 20:59:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdMfVAjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23162303934353330', 'path': '/dev/sdh'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162303934353330', 'path': '/dev/sdh'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 20:59:26 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:26 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:59:26 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 20:59:26 user nova-compute[72620]:   <serial>95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc</serial>
Aug 09 20:59:26 user nova-compute[72620]: </disk>
Aug 09 20:59:26 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] No VIF found with MAC fa:16:3e:f0:09:7b, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-68b8fd82-3de6-41a7-8920-3349c2c54510 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.233s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:28 user nova-compute[72620]: INFO nova.compute.manager [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Detaching volume caa9b00f-88b9-4a9c-82ac-897be98ab1a0
Aug 09 20:59:28 user nova-compute[72620]: INFO nova.virt.block_device [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attempting to driver detach volume caa9b00f-88b9-4a9c-82ac-897be98ab1a0 from mountpoint /dev/vdb
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Attempting to detach device vdb from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:28 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:28 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:59:28 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:59:28 user nova-compute[72620]:   <serial>caa9b00f-88b9-4a9c-82ac-897be98ab1a0</serial>
Aug 09 20:59:28 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:59:28 user nova-compute[72620]: </disk>
Aug 09 20:59:28 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdb from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the persistent domain config.
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:28 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:28 user nova-compute[72620]:   <source dev="/dev/sdg"/>
Aug 09 20:59:28 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 20:59:28 user nova-compute[72620]:   <serial>caa9b00f-88b9-4a9c-82ac-897be98ab1a0</serial>
Aug 09 20:59:28 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 20:59:28 user nova-compute[72620]: </disk>
Aug 09 20:59:28 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-changed-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Refreshing instance network info cache due to event network-changed-9199219e-f820-4862-8434-fb507c9a3f8a. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] Acquiring lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] Acquired lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Refreshing network info cache for port 9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614768.956756, 97b04c22-1012-49b9-b592-a33dcd5f61e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:59:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdb from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the live domain config.
Aug 09 20:59:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CnZBwsqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c1ecb-b92d-489b-aa21-574f729837e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[18558b79-fdbf-47fe-8ca1-54e1c6e64e73]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 (non-flash)
Aug 09 20:59:29 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5032cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0'): ({'sdg'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Removing single pathed devices sdg {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.039s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16447ca5-7219-4990-800b-f1868213dbc3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9474e-bf21-41f0-ac8f-41ab06f11f1a]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flushing IO for device /dev/sdg {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[77da2fc1-45e7-451d-9c8d-150f2e07300d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2688b5e0-2583-43f3-ab43-e853c22c7ecc]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] SCSI volumes sdg have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a09ab9-ea0a-4f62-98de-32fb89067029]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c884f9-fbe3-4309-9a86-03f01edcd315]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260]
Aug 09 20:59:29 user nova-compute[72620]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caa9b00f-88b9-4a9c-82ac-897be98ab1a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a25169-08c7-4756-b016-bbf23074f46d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== disconnect_volume: return (400ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updated VIF entry in instance network info cache for port 9199219e-f820-4862-8434-fb507c9a3f8a. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG nova.network.neutron [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updating instance_info_cache with network_info: [{"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bfc42f22-87c4-47d0-a39d-eb72bd701fb6 req-c56645a8-f3c3-40a1-a61f-f70e7611c4cd service nova] Releasing lock "refresh_cache-ed30c83d-30a4-40e0-9850-012284c06317" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:29 user nova-compute[72620]: INFO nova.compute.manager [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Terminating instance
Aug 09 20:59:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2c326069-cd00-47b1-89df-de8fab0cedde tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Instance destroyed successfully.
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid ed30c83d-30a4-40e0-9850-012284c06317 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1159825049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1159825049',id=32,image_ref='09f2d369-649b-4b40-8daf-c1a78684336c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP0t1IAT7RmTIl6fHdGESz0kcX+lhSbWhheRC/KopESoVTFe+ZA83DSgZF4HQzgffHbo1zhaVQMXfvZjGHY7P/e0N+ksZ5LFiM1pP1Kq9XNrPo6+vctIbqeJPHXPO714w==',key_name='tempest-keypair-432194948',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-dztwaj3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2025401623',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=ed30c83d-30a4-40e0-9850-012284c06317,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9199219e-f820-4862-8434-fb507c9a3f8a", "address": "fa:16:3e:44:e2:85", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9199219e-f8", "ovs_interfaceid": "9199219e-f820-4862-8434-fb507c9a3f8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_vif [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9199219e-f8, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:59:30 user nova-compute[72620]: INFO os_vif [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e2:85,bridge_name='br-int',has_traffic_filtering=True,id=9199219e-f820-4862-8434-fb507c9a3f8a,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9199219e-f8')
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RuHcUNtM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:30 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[24391ec4-5cc0-4ea7-ad66-2498e738c0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f809f712-eb0b-44db-a77a-7495e91e6fd8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:30 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d280940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c'): ({'sdf'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdf {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[839b2485-9ace-4846-a0a1-6c28d2454445]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be218443-6bb9-406d-982f-0cd7e4f08756]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdf {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[53114ebd-1b27-4205-ba5e-4746033b7cf7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[728b1fec-c381-4ae6-b294-ca3cff3609b1]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdf have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO35c13a18-9d4f99f22e97543a', '/dev/disk/by-id/scsi-23964346639396632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_35c13a18') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2cd9d0-6ebf-4f60-9d28-73073cbbf35b]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db00ba6-b05b-4589-8b15-06ab3d99a5b8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02b1c4-fa5a-4795-8ea4-cceac9d131a1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260]
Aug 09 20:59:30 user nova-compute[72620]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:30 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7633c-e581-4077-b1b4-d49293e6246c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74805e18-28dc-474c-8409-3eed1fe2ef71]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (315ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Deleting instance files /opt/stack/data/nova/instances/ed30c83d-30a4-40e0-9850-012284c06317_del
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Deletion of /opt/stack/data/nova/instances/ed30c83d-30a4-40e0-9850-012284c06317_del complete
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.compute.manager [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-unplugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] No waiting events found dispatching network-vif-unplugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-unplugged-9199219e-f820-4862-8434-fb507c9a3f8a for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Acquiring lock "ed30c83d-30a4-40e0-9850-012284c06317-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] Lock "ed30c83d-30a4-40e0-9850-012284c06317-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] No waiting events found dispatching network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:30 user nova-compute[72620]: WARNING nova.compute.manager [req-3191bd98-3c3a-4152-860c-75bbc4e4e429 req-f6d92e21-92c2-43f2-b0e4-efeb4438e4c9 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received unexpected event network-vif-plugged-9199219e-f820-4862-8434-fb507c9a3f8a for instance with vm_state active and task_state deleting.
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.compute.manager [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Detaching volume 95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.virt.block_device [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Attempting to driver detach volume 95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc from mountpoint /dev/vdc
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Attempting to detach device vdc from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:30 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:30 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:59:30 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 20:59:30 user nova-compute[72620]:   <serial>95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc</serial>
Aug 09 20:59:30 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 20:59:30 user nova-compute[72620]: </disk>
Aug 09 20:59:30 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdc from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the persistent domain config.
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 20:59:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 20:59:30 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 20:59:30 user nova-compute[72620]:   <source dev="/dev/sdh"/>
Aug 09 20:59:30 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 20:59:30 user nova-compute[72620]:   <serial>95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc</serial>
Aug 09 20:59:30 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 20:59:30 user nova-compute[72620]: </disk>
Aug 09 20:59:30 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614771.314862, 97b04c22-1012-49b9-b592-a33dcd5f61e9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 20:59:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully detached device vdc from instance 97b04c22-1012-49b9-b592-a33dcd5f61e9 from the live domain config.
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdMfVAjL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 20:59:31 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e92130-5937-4313-9518-68b31ef3167e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf771f2-4495-498c-ae20-527f8e3d5240]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 20:59:31 user nova-compute[72620]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc (non-flash)
Aug 09 20:59:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d282b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc'): ({'sdh'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Removing single pathed devices sdh {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614756.3914044, 5cff4311-d84e-497e-a2c3-41447252fe6b => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:31 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] VM Stopped (Lifecycle Event)
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f56e3-f325-4fc2-b093-434e560bd74d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f098be4c-bea4-47c1-8884-ae49d11bb747 None None] [instance: 5cff4311-d84e-497e-a2c3-41447252fe6b] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[338257e0-77ad-4868-9a35-0f38e02f70b6]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Flushing IO for device /dev/sdh {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2803d-9fdb-4c2e-968b-f469213c8b01]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[004dec34-289f-47c4-b674-10ab93ec38af]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] SCSI volumes sdh have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b6897-7328-42b7-9720-a8ec54c00088]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ee744-6a54-4958-ae83-052bf1a5bcff]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260]
Aug 09 20:59:31 user nova-compute[72620]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc, portal: 172.16.0.220,3260] successful.
Aug 09 20:59:31 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e22cb6-ad6d-4ce9-8162-3b4009c4c5bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6371a6a-5a30-4cb7-be5b-c0b40cc97d76]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] <== disconnect_volume: return (273ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 20:59:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 20:59:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'flavor' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-df7291be-a83f-4cb8-923b-7787834e6aa2 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:32 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Took 1.81 seconds to deallocate network for instance.
Aug 09 20:59:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-09ed3754-fff2-4ff9-b2bd-922d44aeb536 req-1caedf6f-4d81-4b76-92ba-d54489c69553 service nova] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Received event network-vif-deleted-9199219e-f820-4862-8434-fb507c9a3f8a {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:33 user nova-compute[72620]: INFO nova.compute.manager [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Took 0.72 seconds to detach 1 volumes for instance.
Aug 09 20:59:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Deleting volume: 32b7633c-e581-4077-b1b4-d49293e6246c {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:33 user nova-compute[72620]: INFO nova.compute.manager [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Terminating instance
Aug 09 20:59:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:33 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance ed30c83d-30a4-40e0-9850-012284c06317
Aug 09 20:59:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b4b09771-8ae9-4257-ab9c-c9381352dcc3 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "ed30c83d-30a4-40e0-9850-012284c06317" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.353s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Instance destroyed successfully.
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lazy-loading 'resources' on Instance uuid 97b04c22-1012-49b9-b592-a33dcd5f61e9 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1564706831',display_name='tempest-AttachVolumeTestJSON-server-1564706831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1564706831',id=31,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3le8IaLcr+N/lD0xC+ENe7RBkw11yDBn4HeNoeOxxSCwfq41mAJCImVyXvwoocjCWqGIZkZaqIA7m/eBx/g2I1R3O7FZRlPG+edbuAuDUmAR/+69/dGFiesx8Pz3LF6g==',key_name='tempest-keypair-1734539562',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:57:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47da24a245bc4b0e9eb5cb14adf689d6',ramdisk_id='',reservation_id='r-0k8gpy10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-12994001',owner_user_name='tempest-AttachVolumeTestJSON-12994001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7b0bb7bc6434f0b81a7479269348a72',uuid=97b04c22-1012-49b9-b592-a33dcd5f61e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converting VIF {"id": "06567e3a-9932-4546-87b9-39edc1590f97", "address": "fa:16:3e:f0:09:7b", "network": {"id": "09ce31ef-f346-49f8-a1e8-727150f7ec6d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1552794026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47da24a245bc4b0e9eb5cb14adf689d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06567e3a-99", "ovs_interfaceid": "06567e3a-9932-4546-87b9-39edc1590f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG os_vif [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06567e3a-99, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:59:34 user nova-compute[72620]: INFO os_vif [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:09:7b,bridge_name='br-int',has_traffic_filtering=True,id=06567e3a-9932-4546-87b9-39edc1590f97,network=Network(09ce31ef-f346-49f8-a1e8-727150f7ec6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06567e3a-99')
Aug 09 20:59:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Deleting instance files /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9_del
Aug 09 20:59:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Deletion of /opt/stack/data/nova/instances/97b04c22-1012-49b9-b592-a33dcd5f61e9_del complete
Aug 09 20:59:34 user nova-compute[72620]: INFO nova.compute.manager [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:34 user nova-compute[72620]: WARNING nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state active and task_state deleting.
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:34 user nova-compute[72620]: WARNING nova.compute.manager [req-e61ba086-e5ea-4934-a1b9-ddebeb406c0b req-77c72b64-5981-4490-b9ad-1a2b4bf360ce service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state active and task_state deleting.
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:36 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Took 1.92 seconds to deallocate network for instance.
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:36 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Deleted allocations for instance 97b04c22-1012-49b9-b592-a33dcd5f61e9
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d8cc7b2c-5fa2-40b6-8b23-2a467a206f30 tempest-AttachVolumeTestJSON-12994001 tempest-AttachVolumeTestJSON-12994001-project-member] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:36 user nova-compute[72620]: WARNING nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state deleted and task_state None.
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:36 user nova-compute[72620]: WARNING nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-unplugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state deleted and task_state None.
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Acquiring lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] Lock "97b04c22-1012-49b9-b592-a33dcd5f61e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] No waiting events found dispatching network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:36 user nova-compute[72620]: WARNING nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received unexpected event network-vif-plugged-06567e3a-9932-4546-87b9-39edc1590f97 for instance with vm_state deleted and task_state None.
Aug 09 20:59:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-9c0ae3ca-5eae-40ee-9aa1-82f080d5a2ec req-b4a2e888-5e5b-498f-a5a4-caa4f59c3df6 service nova] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Received event network-vif-deleted-06567e3a-9932-4546-87b9-39edc1590f97 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 20:59:38 user nova-compute[72620]: INFO nova.compute.claims [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Claim successful on node user
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 20:59:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.policy [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '111c4dccd3bb4dbab05dc591ca40d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd2c07ea7f842229e5314dafe75ff83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 20:59:38 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Creating image(s)
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "/opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "/opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "/opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk 1073741824" returned: 0 in 0.053s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Successfully created port: 6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Cannot resize image /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.objects.instance [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'migration_context' on Instance uuid af00c508-a61d-4552-b6f6-3986a7ace32f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Ensure instance console log exists: /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Successfully updated port: 6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquired lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-changed-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Refreshing instance network info cache due to event network-changed-6440dc2d-c50d-48b7-826f-8cf81a86a0a4. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] Acquiring lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updating instance_info_cache with network_info: [{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Releasing lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Instance network_info: |[{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] Acquired lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Refreshing network info cache for port 6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Start _get_guest_xml network_info=[{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 20:59:40 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:59:40 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579621216',display_name='tempest-ServersNegativeTestJSON-server-1579621216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579621216',id=34,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-bab7s4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:59:39Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=af00c508-a61d-4552-b6f6-3986a7ace32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'pci_devices' on Instance uuid af00c508-a61d-4552-b6f6-3986a7ace32f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 20:59:40 user nova-compute[72620]:   <uuid>af00c508-a61d-4552-b6f6-3986a7ace32f</uuid>
Aug 09 20:59:40 user nova-compute[72620]:   <name>instance-00000022</name>
Aug 09 20:59:40 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 20:59:40 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 20:59:40 user nova-compute[72620]:   <metadata>
Aug 09 20:59:40 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 20:59:40 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:name>tempest-ServersNegativeTestJSON-server-1579621216</nova:name>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:creationTime>2023-08-09 20:59:40</nova:creationTime>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 20:59:40 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 20:59:40 user nova-compute[72620]:       </nova:flavor>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:owner>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:user uuid="111c4dccd3bb4dbab05dc591ca40d7bc">tempest-ServersNegativeTestJSON-905468876-project-member</nova:user>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:project uuid="1bd2c07ea7f842229e5314dafe75ff83">tempest-ServersNegativeTestJSON-905468876</nova:project>
Aug 09 20:59:40 user nova-compute[72620]:       </nova:owner>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 20:59:40 user nova-compute[72620]:       <nova:ports>
Aug 09 20:59:40 user nova-compute[72620]:         <nova:port uuid="6440dc2d-c50d-48b7-826f-8cf81a86a0a4">
Aug 09 20:59:40 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 20:59:40 user nova-compute[72620]:         </nova:port>
Aug 09 20:59:40 user nova-compute[72620]:       </nova:ports>
Aug 09 20:59:40 user nova-compute[72620]:     </nova:instance>
Aug 09 20:59:40 user nova-compute[72620]:   </metadata>
Aug 09 20:59:40 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 20:59:40 user nova-compute[72620]:     <system>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="serial">af00c508-a61d-4552-b6f6-3986a7ace32f</entry>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="uuid">af00c508-a61d-4552-b6f6-3986a7ace32f</entry>
Aug 09 20:59:40 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 20:59:40 user nova-compute[72620]:     </system>
Aug 09 20:59:40 user nova-compute[72620]:   </sysinfo>
Aug 09 20:59:40 user nova-compute[72620]:   <os>
Aug 09 20:59:40 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 20:59:40 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 20:59:40 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 20:59:40 user nova-compute[72620]:   </os>
Aug 09 20:59:40 user nova-compute[72620]:   <features>
Aug 09 20:59:40 user nova-compute[72620]:     <acpi/>
Aug 09 20:59:40 user nova-compute[72620]:     <apic/>
Aug 09 20:59:40 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 20:59:40 user nova-compute[72620]:   </features>
Aug 09 20:59:40 user nova-compute[72620]:   <clock offset="utc">
Aug 09 20:59:40 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 20:59:40 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 20:59:40 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 20:59:40 user nova-compute[72620]:   </clock>
Aug 09 20:59:40 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 20:59:40 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 20:59:40 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 20:59:40 user nova-compute[72620]:   </cpu>
Aug 09 20:59:40 user nova-compute[72620]:   <devices>
Aug 09 20:59:40 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 20:59:40 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 20:59:40 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk"/>
Aug 09 20:59:40 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 20:59:40 user nova-compute[72620]:     </disk>
Aug 09 20:59:40 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 20:59:40 user nova-compute[72620]:       <mac address="fa:16:3e:c1:59:da"/>
Aug 09 20:59:40 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:59:40 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 20:59:40 user nova-compute[72620]:       <target dev="tap6440dc2d-c5"/>
Aug 09 20:59:40 user nova-compute[72620]:     </interface>
Aug 09 20:59:40 user nova-compute[72620]:     <serial type="pty">
Aug 09 20:59:40 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/console.log" append="off"/>
Aug 09 20:59:40 user nova-compute[72620]:     </serial>
Aug 09 20:59:40 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 20:59:40 user nova-compute[72620]:     <video>
Aug 09 20:59:40 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 20:59:40 user nova-compute[72620]:     </video>
Aug 09 20:59:40 user nova-compute[72620]:     <rng model="virtio">
Aug 09 20:59:40 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 20:59:40 user nova-compute[72620]:     </rng>
Aug 09 20:59:40 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 20:59:40 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 20:59:40 user nova-compute[72620]:       <stats period="10"/>
Aug 09 20:59:40 user nova-compute[72620]:     </memballoon>
Aug 09 20:59:40 user nova-compute[72620]:   </devices>
Aug 09 20:59:40 user nova-compute[72620]: </domain>
Aug 09 20:59:40 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579621216',display_name='tempest-ServersNegativeTestJSON-server-1579621216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579621216',id=34,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-bab7s4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T20:59:39Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=af00c508-a61d-4552-b6f6-3986a7ace32f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG os_vif [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6440dc2d-c5, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6440dc2d-c5, col_values=(('external_ids', {'iface-id': '6440dc2d-c50d-48b7-826f-8cf81a86a0a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:59:da', 'vm-uuid': 'af00c508-a61d-4552-b6f6-3986a7ace32f'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:40 user nova-compute[72620]: INFO os_vif [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5')
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] No VIF found with MAC fa:16:3e:c1:59:da, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updated VIF entry in instance network info cache for port 6440dc2d-c50d-48b7-826f-8cf81a86a0a4. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG nova.network.neutron [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updating instance_info_cache with network_info: [{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 20:59:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eed11928-2fbc-445e-85b3-b7ea8f0e513c req-c8e36db5-f1d7-4bf8-b405-afec2ffd9326 service nova] Releasing lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] No waiting events found dispatching network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:42 user nova-compute[72620]: WARNING nova.compute.manager [req-b45092cf-b6a4-4bd5-90f6-2b9a33aafaa5 req-a98de653-6787-4c52-b1bb-7cef80cd3a1f service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received unexpected event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 for instance with vm_state building and task_state spawning.
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614784.4516015, af00c508-a61d-4552-b6f6-3986a7ace32f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] VM Resumed (Lifecycle Event)
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Instance spawned successfully.
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] No waiting events found dispatching network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 20:59:44 user nova-compute[72620]: WARNING nova.compute.manager [req-453f24fe-3693-4cd9-9d73-307a7cbbbed5 req-95c0ff41-0dd5-42b3-864f-00e8832d08c6 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received unexpected event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 for instance with vm_state building and task_state spawning.
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614784.454373, af00c508-a61d-4552-b6f6-3986a7ace32f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] VM Started (Lifecycle Event)
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 09 20:59:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:44 user nova-compute[72620]: INFO nova.compute.manager [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Took 6.70 seconds to build instance.
Aug 09 20:59:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-78a6d0ec-4412-42ba-853c-569bac1366cb tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.794s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 20:59:45 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614770.277039, ed30c83d-30a4-40e0-9850-012284c06317 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:45 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: ed30c83d-30a4-40e0-9850-012284c06317] VM Stopped (Lifecycle Event)
Aug 09 20:59:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6f4a1644-6677-4ea9-b6cb-c099c4c6557d None None] [instance: ed30c83d-30a4-40e0-9850-012284c06317] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:49 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614774.201932, 97b04c22-1012-49b9-b592-a33dcd5f61e9 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 20:59:49 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] VM Stopped (Lifecycle Event)
Aug 09 20:59:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-89074b73-0894-4a8f-b590-207103f0eb3b None None] [instance: 97b04c22-1012-49b9-b592-a33dcd5f61e9] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 20:59:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 20:59:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:00 user nova-compute[72620]: INFO nova.compute.manager [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Unrescuing
Aug 09 21:00:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquired lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing instance network info cache due to event network-changed-0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating instance_info_cache with network_info: [{"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Releasing lock "refresh_cache-fbe8ab3e-6f7d-4820-8990-cdccac4f467f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'flavor' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Refreshing network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated VIF entry in instance network info cache for port 0204bf3f-57ea-46ae-a128-69fb487866ff. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG nova.network.neutron [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0c537531-a625-4be7-b835-a7a8baf13697 req-77582f24-9be6-46db-802b-6fdedf076af7 service nova] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance destroyed successfully.
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Stashing vm_state: active {{(pid=72620) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_requests' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:00:04 user nova-compute[72620]: INFO nova.compute.claims [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Claim successful on node user
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'resources' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'pci_devices' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:04 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating resource usage from migration 70490e38-fcca-4c76-9024-4dbad949d0bb
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-changed-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Refreshing instance network info cache due to event network-changed-3c571ba7-c628-4dda-838a-4675f8c56611. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.network.neutron [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Refreshing network info cache for port 3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.375s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:04 user nova-compute[72620]: INFO nova.compute.manager [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Migrating
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.network.neutron [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updated VIF entry in instance network info cache for port 3c571ba7-c628-4dda-838a-4675f8c56611. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.network.neutron [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:04 user nova-compute[72620]: WARNING nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state rescued and task_state unrescuing.
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:04 user nova-compute[72620]: WARNING nova.compute.manager [req-f56ab02f-76cc-42c1-a28a-c7fba51cd7cc req-e088b733-68a2-4475-adef-d761f66fff60 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state rescued and task_state unrescuing.
Aug 09 21:00:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Starting migrate_disk_and_power_off {{(pid=72620) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:05 user nova-compute[72620]: WARNING nova.compute.manager [req-f47e23ac-34bb-4929-8a77-784ae979c89e req-680575e2-bc40-41df-8084-7580a15d2afd service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state active and task_state resize_migrating.
Aug 09 21:00:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:06 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance destroyed successfully.
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c571ba7-c6, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:00:06 user nova-compute[72620]: INFO os_vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6')
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:00:06 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0395a030-f926-4b11-b4d0-52ec4ef8f0ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0285e403-6da3-499b-a7fc-816fc679c3e0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:06 user nova-compute[72620]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c5032dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:06 user nova-compute[72620]: WARNING nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state rescued and task_state unrescuing.
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:06 user nova-compute[72620]: WARNING nova.compute.manager [req-ebddd310-4993-460e-9abb-a87645975320 req-247c1159-31ce-4c16-940b-c01ed86e6948 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state rescued and task_state unrescuing.
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d484c8c-dd23-4c2b-8a50-60e67d0b076f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[668f0ca1-74df-44c2-b57a-da9201452400]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef0fdf-02eb-44ec-b805-121dfbd7c8b3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[38301fca-1ff1-42a7-9c9b-77b9f57deb41]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObdc45c8a-cd3a90632fcab73c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdc45c8a', '/dev/disk/by-id/scsi-26364336139303633') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba208c41-77c3-4901-95a0-57964ab7d1a3]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136fe04-885e-4598-9bd5-c23290aebbdd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[425bb725-f7db-495c-b4ec-fe9869f2fefa]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]
Aug 09 21:00:06 user nova-compute[72620]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.
Aug 09 21:00:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da30ca6e-9ba9-4bf0-bc0b-0004b0bb6fe6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== disconnect_volume: return (404ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Removed pending event for fbe8ab3e-6f7d-4820-8990-cdccac4f467f due to event {{(pid=72620) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614807.0608463, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Resumed (Lifecycle Event)
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2358a2c-30ee-4d5b-8f1e-184d07935e7e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614807.064758, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Started (Lifecycle Event)
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:07 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 09 21:00:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.compute.manager [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:07 user nova-compute[72620]: WARNING nova.compute.manager [req-4b9bcd9e-1187-412e-887f-be3840aa4e3b req-83029136-d2ec-4223-acbc-76e8d256a862 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state active and task_state resize_migrating.
Aug 09 21:00:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Port 3c571ba7-c628-4dda-838a-4675f8c56611 binding to destination host user is already ACTIVE {{(pid=72620) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:00:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.utils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfdf2d0-49d7-4672-ba0b-142163038fa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e2c9e-4a85-4b79-b0b3-c28000af8c9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757182e-d565-4602-a101-b4e4f4800977]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c5ad06-f50c-462d-9fa1-7a01ed49c9c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:00:09 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52679146-6903-4c6d-8cac-fa79ceac4e59]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG os_brick.utils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:00:11 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:11 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=25.155242919921875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Applying migration context for instance 66d3342a-c39e-4469-890f-3ac8934e8714 as it has an incoming, in-progress migration 70490e38-fcca-4c76-9024-4dbad949d0bb. Migration status is post-migrating {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 21:00:11 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating resource usage from migration 70490e38-fcca-4c76-9024-4dbad949d0bb
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Migration 70490e38-fcca-4c76-9024-4dbad949d0bb is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:00:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Starting finish_migration {{(pid=72620) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance directory exists: not creating {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 09 21:00:19 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Creating image(s)
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Ensure instance console log exists: /opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start _get_guest_xml network_info=[{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '66d3342a-c39e-4469-890f-3ac8934e8714', 'attached_at': '2023-08-09T21:00:19.000000', 'detached_at': '', 'volume_id': 'fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc', 'serial': 'fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '096daf7d-1425-4f5f-ab9a-cdc73fef288f', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:00:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:05Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:00:19 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:00:19 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:00:19 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eac81c-0508-4725-99a6-b3e2996619d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:00:19 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[209a341f-2fca-491e-970b-9e6edb128190]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc] added
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb52f2c-3a6d-446b-9eff-590ba03d6a15]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9210f4fe-17ed-45d2-be41-fe9055ea426c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzXFpqWS {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZzXFpqWS" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4a4c79-00f6-4231-b791-4f52c4258064]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZzXFpqWS'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[071057b3-fb76-4bd4-b9d2-3d5426b4367f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[204467b5-f54a-4f65-a806-32b9af9504aa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5478501-f640-421d-9535-ea7793c2632f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]
Aug 09 21:00:19 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73affc5-728a-49bb-8cc7-f26e2d9faf20]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[97132165-ad00-4c59-a1c7-167d0e82525f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:19 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:19 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a535dd-375b-498e-8839-1db9fe2c9429]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:00:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26364336139303633', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364336139303633', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:00:20 user nova-compute[72620]:   <uuid>66d3342a-c39e-4469-890f-3ac8934e8714</uuid>
Aug 09 21:00:20 user nova-compute[72620]:   <name>instance-00000021</name>
Aug 09 21:00:20 user nova-compute[72620]:   <memory>2097152</memory>
Aug 09 21:00:20 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:00:20 user nova-compute[72620]:   <metadata>
Aug 09 21:00:20 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:00:20 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:00:20 user nova-compute[72620]:       <nova:name>tempest-ServerActionsTestOtherA-server-1106592924</nova:name>
Aug 09 21:00:20 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:00:19</nova:creationTime>
Aug 09 21:00:20 user nova-compute[72620]:       <nova:flavor name="m1.small">
Aug 09 21:00:20 user nova-compute[72620]:         <nova:memory>2048</nova:memory>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:disk>20</nova:disk>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:00:20 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:00:20 user nova-compute[72620]:       <nova:owner>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:user uuid="1546466d62a6410c83fa85f1b0c8b934">tempest-ServerActionsTestOtherA-763482691-project-member</nova:user>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:project uuid="80ded0dc696e4bd6b25a57202b956d63">tempest-ServerActionsTestOtherA-763482691</nova:project>
Aug 09 21:00:20 user nova-compute[72620]:       </nova:owner>
Aug 09 21:00:20 user nova-compute[72620]:       <nova:ports>
Aug 09 21:00:20 user nova-compute[72620]:         <nova:port uuid="3c571ba7-c628-4dda-838a-4675f8c56611">
Aug 09 21:00:20 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 21:00:20 user nova-compute[72620]:         </nova:port>
Aug 09 21:00:20 user nova-compute[72620]:       </nova:ports>
Aug 09 21:00:20 user nova-compute[72620]:     </nova:instance>
Aug 09 21:00:20 user nova-compute[72620]:   </metadata>
Aug 09 21:00:20 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:00:20 user nova-compute[72620]:     <system>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="serial">66d3342a-c39e-4469-890f-3ac8934e8714</entry>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="uuid">66d3342a-c39e-4469-890f-3ac8934e8714</entry>
Aug 09 21:00:20 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:00:20 user nova-compute[72620]:     </system>
Aug 09 21:00:20 user nova-compute[72620]:   </sysinfo>
Aug 09 21:00:20 user nova-compute[72620]:   <os>
Aug 09 21:00:20 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:00:20 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:00:20 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:00:20 user nova-compute[72620]:   </os>
Aug 09 21:00:20 user nova-compute[72620]:   <features>
Aug 09 21:00:20 user nova-compute[72620]:     <acpi/>
Aug 09 21:00:20 user nova-compute[72620]:     <apic/>
Aug 09 21:00:20 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:00:20 user nova-compute[72620]:   </features>
Aug 09 21:00:20 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:00:20 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:00:20 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:00:20 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:00:20 user nova-compute[72620]:   </clock>
Aug 09 21:00:20 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:00:20 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:00:20 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:00:20 user nova-compute[72620]:   </cpu>
Aug 09 21:00:20 user nova-compute[72620]:   <devices>
Aug 09 21:00:20 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:00:20 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:00:20 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 21:00:20 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:00:20 user nova-compute[72620]:       <serial>fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc</serial>
Aug 09 21:00:20 user nova-compute[72620]:     </disk>
Aug 09 21:00:20 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:00:20 user nova-compute[72620]:       <mac address="fa:16:3e:ff:99:38"/>
Aug 09 21:00:20 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:00:20 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:00:20 user nova-compute[72620]:       <target dev="tap3c571ba7-c6"/>
Aug 09 21:00:20 user nova-compute[72620]:     </interface>
Aug 09 21:00:20 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:00:20 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714/console.log" append="off"/>
Aug 09 21:00:20 user nova-compute[72620]:     </serial>
Aug 09 21:00:20 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:00:20 user nova-compute[72620]:     <video>
Aug 09 21:00:20 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:00:20 user nova-compute[72620]:     </video>
Aug 09 21:00:20 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:00:20 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:00:20 user nova-compute[72620]:     </rng>
Aug 09 21:00:20 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:00:20 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:00:20 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:00:20 user nova-compute[72620]:     </memballoon>
Aug 09 21:00:20 user nova-compute[72620]:   </devices>
Aug 09 21:00:20 user nova-compute[72620]: </domain>
Aug 09 21:00:20 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:00:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-153758314-network", "vif_mac": "fa:16:3e:ff:99:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG os_vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c571ba7-c6, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c571ba7-c6, col_values=(('external_ids', {'iface-id': '3c571ba7-c628-4dda-838a-4675f8c56611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:99:38', 'vm-uuid': '66d3342a-c39e-4469-890f-3ac8934e8714'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:20 user nova-compute[72620]: INFO os_vif [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6')
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:00:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] No VIF found with MAC fa:16:3e:ff:99:38, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:00:21 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614806.2310684, 66d3342a-c39e-4469-890f-3ac8934e8714 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:21 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Stopped (Lifecycle Event)
Aug 09 21:00:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9fdf36de-a6b4-47e2-b886-ccf4b6b66799 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:22 user nova-compute[72620]: WARNING nova.compute.manager [req-bcad6573-8d70-49fa-9a79-35d2ed7e4174 req-31090a24-bfdb-4203-b62c-7af225ef591d service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state active and task_state resize_finish.
Aug 09 21:00:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614824.5029461, 66d3342a-c39e-4469-890f-3ac8934e8714 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Resumed (Lifecycle Event)
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:00:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance running successfully.
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Failed to set time: agent not configured {{(pid=72620) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9968a8fb-fdaf-474c-b0fa-825f5d0728e8 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] finish_migration finished successfully. {{(pid=72620) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614824.5046952, 66d3342a-c39e-4469-890f-3ac8934e8714 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Started (Lifecycle Event)
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:24 user nova-compute[72620]: WARNING nova.compute.manager [req-915b6806-c1ea-42e5-824d-840d0ecf176c req-d5d5ddbe-904c-49f1-addd-33fb81707f0c service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state active and task_state resize_finish.
Aug 09 21:00:24 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 09 21:00:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:25 user nova-compute[72620]: INFO nova.compute.manager [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Terminating instance
Aug 09 21:00:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Instance destroyed successfully.
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid 3d349b12-2b7a-4fc7-b045-4505a6434105 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:55:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1392306553',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1392306553',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCV/eZgskWob22Bicu7NJTW73Y5J6D9kwmMjp5SpSM8nxO9LeJDVsYgCg73orA2d7SDks3+oDgcSRDs8NinemECUTB4iEn17ttpJF9xKEJQc1QpHTTf2Y4/QymiVxjHIA==',key_name='tempest-keypair-1936608708',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:55:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-mhb4qcoo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=3d349b12-2b7a-4fc7-b045-4505a6434105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "address": "fa:16:3e:2b:b0:52", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b4cf43f-2b", "ovs_interfaceid": "5b4cf43f-2b26-43fc-8fe9-51d6f0014379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_vif [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b4cf43f-2b, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:00:26 user nova-compute[72620]: INFO os_vif [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:b0:52,bridge_name='br-int',has_traffic_filtering=True,id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b4cf43f-2b')
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dXbmUKSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:00:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc1c97-d3de-4e51-8619-a70dc9ff9d1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[146132ce-94b2-4028-a006-499b23a3d677]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:00:26 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:00:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3030b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fad81ef-3e0f-4967-b03c-673ccae8ca30]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6e1e1-9840-407f-8bf2-0942d5f208cd]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.040s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c705d-8dda-4953-8952-6eea9ff8c11f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553fce0-6f8b-4a8c-9ae0-cc5cfaab8c40]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b3be545b', '/dev/disk/by-id/scsi-23661376362326136', '/dev/disk/by-id/scsi-1SCST_BIOb3be545b-6a7cb2a6a62ce4a5') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f0e17a-6bcb-4b5e-a4d5-4058bc8858ed]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a028e41-4de1-4681-8792-07e64c800938]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9631dc-8fde-47f2-bc3d-ea76c8a52885]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260]
Aug 09 21:00:26 user nova-compute[72620]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f, portal: 172.16.0.220,3260] successful.
Aug 09 21:00:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-unplugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] No waiting events found dispatching network-vif-unplugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-unplugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Acquiring lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] No waiting events found dispatching network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:26 user nova-compute[72620]: WARNING nova.compute.manager [req-2da8b4a1-f97b-493a-9473-6f658f7e5ad4 req-d0755284-7ee8-4659-9596-5671ed5d805f service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received unexpected event network-vif-plugged-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 for instance with vm_state active and task_state deleting.
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af4a9e94-5fe1-4aff-ad3b-d7860766e67f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc1250-fd4f-4019-997d-2646697f3de8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (376ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:00:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Deleting instance files /opt/stack/data/nova/instances/3d349b12-2b7a-4fc7-b045-4505a6434105_del
Aug 09 21:00:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Deletion of /opt/stack/data/nova/instances/3d349b12-2b7a-4fc7-b045-4505a6434105_del complete
Aug 09 21:00:26 user nova-compute[72620]: INFO nova.compute.manager [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 09 21:00:26 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:00:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:29 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:29 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Took 2.56 seconds to deallocate network for instance.
Aug 09 21:00:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-79094062-1e94-429e-833a-ea79476726f4 req-0332007a-2f35-49f7-955e-703cfda74089 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Received event network-vif-deleted-5b4cf43f-2b26-43fc-8fe9-51d6f0014379 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:29 user nova-compute[72620]: INFO nova.compute.manager [req-79094062-1e94-429e-833a-ea79476726f4 req-0332007a-2f35-49f7-955e-703cfda74089 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Neutron deleted interface 5b4cf43f-2b26-43fc-8fe9-51d6f0014379; detaching it from the instance and deleting it from the info cache
Aug 09 21:00:29 user nova-compute[72620]: DEBUG nova.network.neutron [req-79094062-1e94-429e-833a-ea79476726f4 req-0332007a-2f35-49f7-955e-703cfda74089 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-79094062-1e94-429e-833a-ea79476726f4 req-0332007a-2f35-49f7-955e-703cfda74089 service nova] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Detach interface failed, port_id=5b4cf43f-2b26-43fc-8fe9-51d6f0014379, reason: Instance 3d349b12-2b7a-4fc7-b045-4505a6434105 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:00:30 user nova-compute[72620]: INFO nova.compute.manager [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Took 0.85 seconds to detach 1 volumes for instance.
Aug 09 21:00:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Deleting volume: af4a9e94-5fe1-4aff-ad3b-d7860766e67f {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 21:00:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:30 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:00:30 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:00:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:30 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance 3d349b12-2b7a-4fc7-b045-4505a6434105
Aug 09 21:00:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-31a445a6-27c4-4f6d-bd7b-698e8b4f0919 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "3d349b12-2b7a-4fc7-b045-4505a6434105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.540s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:00:34 user nova-compute[72620]: INFO nova.compute.claims [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Claim successful on node user
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:00:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.policy [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'caf15688989f4593abde969f30583860', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '480451d779014fc8ab7ded49e1c6695c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:00:34 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Creating image(s)
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "/opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "/opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "/opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk 1073741824" returned: 0 in 0.057s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Cannot resize image /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'migration_context' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Ensure instance console log exists: /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Successfully created port: fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Successfully updated port: fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquired lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-changed-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Refreshing instance network info cache due to event network-changed-fc822545-f704-4016-96fa-78889b3e26b7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] Acquiring lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updating instance_info_cache with network_info: [{"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Releasing lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Instance network_info: |[{"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] Acquired lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.neutron [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Refreshing network info cache for port fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Start _get_guest_xml network_info=[{"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:00:36 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:36 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1948717',id=35,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+AslKod0pMarHkGZfD8Wqbde9sJ/j71APr0A3qk+KOGpfqxU7hznN4uz+1KlFvXxzEf66jPihJ18ki2isApdMhoXo/Vocp+EUTEfhadsPy87eYJkYTtlowIqieH+WyzA==',key_name='tempest-keypair-745541158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='480451d779014fc8ab7ded49e1c6695c',ramdisk_id='',reservation_id='r-zktz7l19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caf15688989f4593abde969f30583860',uuid=fce385df-f5dd-4a0a-bdcc-916414124f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converting VIF {"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:36 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'pci_devices' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:00:37 user nova-compute[72620]:   <uuid>fce385df-f5dd-4a0a-bdcc-916414124f48</uuid>
Aug 09 21:00:37 user nova-compute[72620]:   <name>instance-00000023</name>
Aug 09 21:00:37 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:00:37 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:00:37 user nova-compute[72620]:   <metadata>
Aug 09 21:00:37 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:00:37 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016</nova:name>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:00:36</nova:creationTime>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:00:37 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:00:37 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:owner>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:user uuid="caf15688989f4593abde969f30583860">tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member</nova:user>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:project uuid="480451d779014fc8ab7ded49e1c6695c">tempest-TestServerVolumeAttachScenarioOldVersion-488278334</nova:project>
Aug 09 21:00:37 user nova-compute[72620]:       </nova:owner>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:00:37 user nova-compute[72620]:       <nova:ports>
Aug 09 21:00:37 user nova-compute[72620]:         <nova:port uuid="fc822545-f704-4016-96fa-78889b3e26b7">
Aug 09 21:00:37 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 09 21:00:37 user nova-compute[72620]:         </nova:port>
Aug 09 21:00:37 user nova-compute[72620]:       </nova:ports>
Aug 09 21:00:37 user nova-compute[72620]:     </nova:instance>
Aug 09 21:00:37 user nova-compute[72620]:   </metadata>
Aug 09 21:00:37 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:00:37 user nova-compute[72620]:     <system>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="serial">fce385df-f5dd-4a0a-bdcc-916414124f48</entry>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="uuid">fce385df-f5dd-4a0a-bdcc-916414124f48</entry>
Aug 09 21:00:37 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:00:37 user nova-compute[72620]:     </system>
Aug 09 21:00:37 user nova-compute[72620]:   </sysinfo>
Aug 09 21:00:37 user nova-compute[72620]:   <os>
Aug 09 21:00:37 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:00:37 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:00:37 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:00:37 user nova-compute[72620]:   </os>
Aug 09 21:00:37 user nova-compute[72620]:   <features>
Aug 09 21:00:37 user nova-compute[72620]:     <acpi/>
Aug 09 21:00:37 user nova-compute[72620]:     <apic/>
Aug 09 21:00:37 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:00:37 user nova-compute[72620]:   </features>
Aug 09 21:00:37 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:00:37 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:00:37 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:00:37 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:00:37 user nova-compute[72620]:   </clock>
Aug 09 21:00:37 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:00:37 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:00:37 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:00:37 user nova-compute[72620]:   </cpu>
Aug 09 21:00:37 user nova-compute[72620]:   <devices>
Aug 09 21:00:37 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:00:37 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:00:37 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk"/>
Aug 09 21:00:37 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:00:37 user nova-compute[72620]:     </disk>
Aug 09 21:00:37 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:00:37 user nova-compute[72620]:       <mac address="fa:16:3e:91:d5:9e"/>
Aug 09 21:00:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:00:37 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:00:37 user nova-compute[72620]:       <target dev="tapfc822545-f7"/>
Aug 09 21:00:37 user nova-compute[72620]:     </interface>
Aug 09 21:00:37 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:00:37 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/console.log" append="off"/>
Aug 09 21:00:37 user nova-compute[72620]:     </serial>
Aug 09 21:00:37 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:00:37 user nova-compute[72620]:     <video>
Aug 09 21:00:37 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:00:37 user nova-compute[72620]:     </video>
Aug 09 21:00:37 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:00:37 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:00:37 user nova-compute[72620]:     </rng>
Aug 09 21:00:37 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:00:37 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:00:37 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:00:37 user nova-compute[72620]:     </memballoon>
Aug 09 21:00:37 user nova-compute[72620]:   </devices>
Aug 09 21:00:37 user nova-compute[72620]: </domain>
Aug 09 21:00:37 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1948717',id=35,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+AslKod0pMarHkGZfD8Wqbde9sJ/j71APr0A3qk+KOGpfqxU7hznN4uz+1KlFvXxzEf66jPihJ18ki2isApdMhoXo/Vocp+EUTEfhadsPy87eYJkYTtlowIqieH+WyzA==',key_name='tempest-keypair-745541158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='480451d779014fc8ab7ded49e1c6695c',ramdisk_id='',reservation_id='r-zktz7l19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caf15688989f4593abde969f30583860',uuid=fce385df-f5dd-4a0a-bdcc-916414124f48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converting VIF {"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG os_vif [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfc822545-f7, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfc822545-f7, col_values=(('external_ids', {'iface-id': 'fc822545-f704-4016-96fa-78889b3e26b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:d5:9e', 'vm-uuid': 'fce385df-f5dd-4a0a-bdcc-916414124f48'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:37 user nova-compute[72620]: INFO os_vif [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7')
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] No VIF found with MAC fa:16:3e:91:d5:9e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.network.neutron [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updated VIF entry in instance network info cache for port fc822545-f704-4016-96fa-78889b3e26b7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG nova.network.neutron [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updating instance_info_cache with network_info: [{"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6633e63b-6ec5-4571-83b0-3a851a192fee req-aedfbac3-3164-4c79-8e15-43d2e63492e3 service nova] Releasing lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:00:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] No waiting events found dispatching network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:38 user nova-compute[72620]: WARNING nova.compute.manager [req-2ab41c4a-e064-43c7-befd-4d9d79b6c023 req-3ab312f6-534e-4f1a-a253-fe244bc0ce41 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received unexpected event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 for instance with vm_state building and task_state spawning.
Aug 09 21:00:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614840.5652099, fce385df-f5dd-4a0a-bdcc-916414124f48 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] VM Resumed (Lifecycle Event)
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Instance spawned successfully.
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614840.568568, fce385df-f5dd-4a0a-bdcc-916414124f48 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] VM Started (Lifecycle Event)
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Took 5.85 seconds to spawn the instance on the hypervisor.
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] No waiting events found dispatching network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:00:40 user nova-compute[72620]: WARNING nova.compute.manager [req-a6ef4524-40e1-446c-accd-9dd5de81e70c req-a90147a7-0225-4f8b-9ab7-4d263549530a service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received unexpected event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 for instance with vm_state building and task_state spawning.
Aug 09 21:00:40 user nova-compute[72620]: INFO nova.compute.manager [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Took 6.59 seconds to build instance.
Aug 09 21:00:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ba4bb833-880e-4309-a94f-c5971dd1024f tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.685s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:00:41 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614826.3058555, 3d349b12-2b7a-4fc7-b045-4505a6434105 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:00:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] VM Stopped (Lifecycle Event)
Aug 09 21:00:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9dc97911-e36f-4ab9-9a55-48c9e5a7019e None None] [instance: 3d349b12-2b7a-4fc7-b045-4505a6434105] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:00:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:00:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:01:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updating instance_info_cache with network_info: [{"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-2ba125ef-76c1-44b7-a08c-bdbd7e378f90" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:01:03 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:03 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:01:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:10 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:01:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:13 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:13 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7644MB free_disk=25.113231658935547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Applying migration context for instance 66d3342a-c39e-4469-890f-3ac8934e8714 as it has an incoming, in-progress migration 70490e38-fcca-4c76-9024-4dbad949d0bb. Migration status is finished {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 09 21:01:13 user nova-compute[72620]: INFO nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating resource usage from migration 70490e38-fcca-4c76-9024-4dbad949d0bb
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Migration 70490e38-fcca-4c76-9024-4dbad949d0bb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fce385df-f5dd-4a0a-bdcc-916414124f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:01:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:28 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:01:28 user nova-compute[72620]: INFO nova.compute.claims [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Claim successful on node user
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:01:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.policy [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:29 user nova-compute[72620]: INFO nova.virt.block_device [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Booting with volume 4f06b0a8-2394-49ca-99a4-102648900a33 at /dev/vda
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.utils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb40fec-67a9-4f07-b396-e5132d2895f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f146e866-4eb9-4648-a7d6-b740d995ecaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:01:29 user nova-compute[72620]: INFO nova.compute.claims [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Claim successful on node user
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d9c4d-9d40-4186-ac66-732da014bbf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf468cc-9f8b-43f0-99a7-d4d046e62296]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:01:29 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:01:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7471d6-c945-4844-98b1-a1373577e549]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG os_brick.utils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:01:29 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updating existing volume attachment record: 1581beef-165b-424e-a8b8-130c1ada81e3 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:01:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:01:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Creating image(s)
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "/opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "/opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Successfully created port: d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.policy [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '111c4dccd3bb4dbab05dc591ca40d7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bd2c07ea7f842229e5314dafe75ff83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk 1073741824" returned: 0 in 0.053s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.180s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:01:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Cannot resize image /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'migration_context' on Instance uuid b9633463-fbae-481f-bcc9-ac784471eda4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Ensure instance console log exists: /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Successfully updated port: d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-changed-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Refreshing instance network info cache due to event network-changed-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] Acquiring lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] Acquired lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Refreshing network info cache for port d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Successfully created port: bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cad79c02-850d-4c7f-b252-baf0e4cc578b req-5eb581d4-497d-4f17-9af8-78eb43fde9a4 service nova] Releasing lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:01:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updating instance_info_cache with network_info: [{"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance network_info: |[{"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Successfully updated port: bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquired lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-changed-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Refreshing instance network info cache due to event network-changed-bfce28fe-062c-4340-b79e-afe43e52352e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] Acquiring lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Updating instance_info_cache with network_info: [{"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Releasing lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Instance network_info: |[{"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] Acquired lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Refreshing network info cache for port bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Start _get_guest_xml network_info=[{"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:01:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700982147',display_name='tempest-ServersNegativeTestJSON-server-700982147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700982147',id=37,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-s453uzcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:01:30Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=b9633463-fbae-481f-bcc9-ac784471eda4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'pci_devices' on Instance uuid b9633463-fbae-481f-bcc9-ac784471eda4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:01:32 user nova-compute[72620]:   <uuid>b9633463-fbae-481f-bcc9-ac784471eda4</uuid>
Aug 09 21:01:32 user nova-compute[72620]:   <name>instance-00000025</name>
Aug 09 21:01:32 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:01:32 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:01:32 user nova-compute[72620]:   <metadata>
Aug 09 21:01:32 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:01:32 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:name>tempest-ServersNegativeTestJSON-server-700982147</nova:name>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:01:32</nova:creationTime>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:01:32 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:01:32 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:owner>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:user uuid="111c4dccd3bb4dbab05dc591ca40d7bc">tempest-ServersNegativeTestJSON-905468876-project-member</nova:user>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:project uuid="1bd2c07ea7f842229e5314dafe75ff83">tempest-ServersNegativeTestJSON-905468876</nova:project>
Aug 09 21:01:32 user nova-compute[72620]:       </nova:owner>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:01:32 user nova-compute[72620]:       <nova:ports>
Aug 09 21:01:32 user nova-compute[72620]:         <nova:port uuid="bfce28fe-062c-4340-b79e-afe43e52352e">
Aug 09 21:01:32 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 21:01:32 user nova-compute[72620]:         </nova:port>
Aug 09 21:01:32 user nova-compute[72620]:       </nova:ports>
Aug 09 21:01:32 user nova-compute[72620]:     </nova:instance>
Aug 09 21:01:32 user nova-compute[72620]:   </metadata>
Aug 09 21:01:32 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:01:32 user nova-compute[72620]:     <system>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="serial">b9633463-fbae-481f-bcc9-ac784471eda4</entry>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="uuid">b9633463-fbae-481f-bcc9-ac784471eda4</entry>
Aug 09 21:01:32 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:01:32 user nova-compute[72620]:     </system>
Aug 09 21:01:32 user nova-compute[72620]:   </sysinfo>
Aug 09 21:01:32 user nova-compute[72620]:   <os>
Aug 09 21:01:32 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:01:32 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:01:32 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:01:32 user nova-compute[72620]:   </os>
Aug 09 21:01:32 user nova-compute[72620]:   <features>
Aug 09 21:01:32 user nova-compute[72620]:     <acpi/>
Aug 09 21:01:32 user nova-compute[72620]:     <apic/>
Aug 09 21:01:32 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:01:32 user nova-compute[72620]:   </features>
Aug 09 21:01:32 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:01:32 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:01:32 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:01:32 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:01:32 user nova-compute[72620]:   </clock>
Aug 09 21:01:32 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:01:32 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:01:32 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:01:32 user nova-compute[72620]:   </cpu>
Aug 09 21:01:32 user nova-compute[72620]:   <devices>
Aug 09 21:01:32 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:01:32 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:01:32 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk"/>
Aug 09 21:01:32 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:01:32 user nova-compute[72620]:     </disk>
Aug 09 21:01:32 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:01:32 user nova-compute[72620]:       <mac address="fa:16:3e:ee:b4:15"/>
Aug 09 21:01:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:01:32 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:01:32 user nova-compute[72620]:       <target dev="tapbfce28fe-06"/>
Aug 09 21:01:32 user nova-compute[72620]:     </interface>
Aug 09 21:01:32 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:01:32 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/console.log" append="off"/>
Aug 09 21:01:32 user nova-compute[72620]:     </serial>
Aug 09 21:01:32 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:01:32 user nova-compute[72620]:     <video>
Aug 09 21:01:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:01:32 user nova-compute[72620]:     </video>
Aug 09 21:01:32 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:01:32 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:01:32 user nova-compute[72620]:     </rng>
Aug 09 21:01:32 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:01:32 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:01:32 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:01:32 user nova-compute[72620]:     </memballoon>
Aug 09 21:01:32 user nova-compute[72620]:   </devices>
Aug 09 21:01:32 user nova-compute[72620]: </domain>
Aug 09 21:01:32 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700982147',display_name='tempest-ServersNegativeTestJSON-server-700982147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700982147',id=37,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-s453uzcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:01:30Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=b9633463-fbae-481f-bcc9-ac784471eda4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG os_vif [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfce28fe-06, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfce28fe-06, col_values=(('external_ids', {'iface-id': 'bfce28fe-062c-4340-b79e-afe43e52352e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:b4:15', 'vm-uuid': 'b9633463-fbae-481f-bcc9-ac784471eda4'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:32 user nova-compute[72620]: INFO os_vif [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06')
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:01:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] No VIF found with MAC fa:16:3e:ee:b4:15, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:01:33 user nova-compute[72620]: DEBUG nova.network.neutron [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Updated VIF entry in instance network info cache for port bfce28fe-062c-4340-b79e-afe43e52352e. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:01:33 user nova-compute[72620]: DEBUG nova.network.neutron [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Updating instance_info_cache with network_info: [{"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-46ec2353-556f-4055-ad33-db862c492c4d req-af532150-e9b0-4979-8299-5b61aadbe68b service nova] Releasing lock "refresh_cache-b9633463-fbae-481f-bcc9-ac784471eda4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] No waiting events found dispatching network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:34 user nova-compute[72620]: WARNING nova.compute.manager [req-3dbe1767-4330-4d1c-af95-85b012a8d074 req-f6727da7-25b4-4cb2-a204-d1135c8501df service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received unexpected event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e for instance with vm_state building and task_state spawning.
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614896.343858, b9633463-fbae-481f-bcc9-ac784471eda4 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] VM Resumed (Lifecycle Event)
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Instance spawned successfully.
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614896.3503664, b9633463-fbae-481f-bcc9-ac784471eda4 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] VM Started (Lifecycle Event)
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] No waiting events found dispatching network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:36 user nova-compute[72620]: WARNING nova.compute.manager [req-72f81567-2897-4331-a4f0-33f9f31ddc27 req-b4bddf60-0c05-4495-a496-a66e922ae3c3 service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received unexpected event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e for instance with vm_state building and task_state spawning.
Aug 09 21:01:36 user nova-compute[72620]: INFO nova.compute.manager [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Took 7.07 seconds to build instance.
Aug 09 21:01:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cfeb10c2-385a-4430-9e72-73f1dfece748 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.192s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:01:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Creating image(s)
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Ensure instance console log exists: /opt/stack/data/nova/instances/64f1935f-104d-4f72-9e40-ea5335d775c1/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Start _get_guest_xml network_info=[{"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64f1935f-104d-4f72-9e40-ea5335d775c1', 'attached_at': '', 'detached_at': '', 'volume_id': '4f06b0a8-2394-49ca-99a4-102648900a33', 'serial': '4f06b0a8-2394-49ca-99a4-102648900a33'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '1581beef-165b-424e-a8b8-130c1ada81e3', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:01:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:01:39 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:01:39 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:01:39 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba68f1d-81f8-483b-a38d-a11023baee4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:01:39 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba612440-512e-40ef-8224-570886ca2cc6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33] added
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dadfe3-5f7c-4de2-806f-fc4807b3b752]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a5a7a0-8191-4358-9af5-6aa62051067e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZiqvhjM {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZiqvhjM" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[154bd95f-d036-4073-ac9e-2914da51ffa5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZiqvhjM'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66efb2-d5a4-47cb-b041-9d2ef496103f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[49842026-a53a-42fa-a4e0-49509e613aef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9fd71a-d222-4561-a277-be3e46789a6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]
Aug 09 21:01:39 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b685cdc3-37eb-44cf-9737-000004916dc4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d8a1c-f195-43fe-ad91-c9a6fffd394d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:39 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:01:39 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[336badd9-0920-4674-bc7c-36e0641e9755]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:01:39 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23239303930643232', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239303930643232', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905103780',display_name='tempest-TestVolumeBootPattern-server-1905103780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905103780',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-qskkz1mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:01:29Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=64f1935f-104d-4f72-9e40-ea5335d775c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid 64f1935f-104d-4f72-9e40-ea5335d775c1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:01:40 user nova-compute[72620]:   <uuid>64f1935f-104d-4f72-9e40-ea5335d775c1</uuid>
Aug 09 21:01:40 user nova-compute[72620]:   <name>instance-00000024</name>
Aug 09 21:01:40 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:01:40 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:01:40 user nova-compute[72620]:   <metadata>
Aug 09 21:01:40 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:01:40 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:01:40 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-server-1905103780</nova:name>
Aug 09 21:01:40 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:01:39</nova:creationTime>
Aug 09 21:01:40 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:01:40 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:01:40 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:01:40 user nova-compute[72620]:       <nova:owner>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 21:01:40 user nova-compute[72620]:       </nova:owner>
Aug 09 21:01:40 user nova-compute[72620]:       <nova:ports>
Aug 09 21:01:40 user nova-compute[72620]:         <nova:port uuid="d0e841b8-e6ef-44e5-b108-b2b125ee1bd6">
Aug 09 21:01:40 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 21:01:40 user nova-compute[72620]:         </nova:port>
Aug 09 21:01:40 user nova-compute[72620]:       </nova:ports>
Aug 09 21:01:40 user nova-compute[72620]:     </nova:instance>
Aug 09 21:01:40 user nova-compute[72620]:   </metadata>
Aug 09 21:01:40 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:01:40 user nova-compute[72620]:     <system>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="serial">64f1935f-104d-4f72-9e40-ea5335d775c1</entry>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="uuid">64f1935f-104d-4f72-9e40-ea5335d775c1</entry>
Aug 09 21:01:40 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:01:40 user nova-compute[72620]:     </system>
Aug 09 21:01:40 user nova-compute[72620]:   </sysinfo>
Aug 09 21:01:40 user nova-compute[72620]:   <os>
Aug 09 21:01:40 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:01:40 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:01:40 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:01:40 user nova-compute[72620]:   </os>
Aug 09 21:01:40 user nova-compute[72620]:   <features>
Aug 09 21:01:40 user nova-compute[72620]:     <acpi/>
Aug 09 21:01:40 user nova-compute[72620]:     <apic/>
Aug 09 21:01:40 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:01:40 user nova-compute[72620]:   </features>
Aug 09 21:01:40 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:01:40 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:01:40 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:01:40 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:01:40 user nova-compute[72620]:   </clock>
Aug 09 21:01:40 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:01:40 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:01:40 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:01:40 user nova-compute[72620]:   </cpu>
Aug 09 21:01:40 user nova-compute[72620]:   <devices>
Aug 09 21:01:40 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:01:40 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:01:40 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 21:01:40 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:01:40 user nova-compute[72620]:       <serial>4f06b0a8-2394-49ca-99a4-102648900a33</serial>
Aug 09 21:01:40 user nova-compute[72620]:     </disk>
Aug 09 21:01:40 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:01:40 user nova-compute[72620]:       <mac address="fa:16:3e:86:41:cc"/>
Aug 09 21:01:40 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:01:40 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:01:40 user nova-compute[72620]:       <target dev="tapd0e841b8-e6"/>
Aug 09 21:01:40 user nova-compute[72620]:     </interface>
Aug 09 21:01:40 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:01:40 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/64f1935f-104d-4f72-9e40-ea5335d775c1/console.log" append="off"/>
Aug 09 21:01:40 user nova-compute[72620]:     </serial>
Aug 09 21:01:40 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:01:40 user nova-compute[72620]:     <video>
Aug 09 21:01:40 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:01:40 user nova-compute[72620]:     </video>
Aug 09 21:01:40 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:01:40 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:01:40 user nova-compute[72620]:     </rng>
Aug 09 21:01:40 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:01:40 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:01:40 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:01:40 user nova-compute[72620]:     </memballoon>
Aug 09 21:01:40 user nova-compute[72620]:   </devices>
Aug 09 21:01:40 user nova-compute[72620]: </domain>
Aug 09 21:01:40 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905103780',display_name='tempest-TestVolumeBootPattern-server-1905103780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905103780',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-qskkz1mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:01:29Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=64f1935f-104d-4f72-9e40-ea5335d775c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG os_vif [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0e841b8-e6, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0e841b8-e6, col_values=(('external_ids', {'iface-id': 'd0e841b8-e6ef-44e5-b108-b2b125ee1bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:41:cc', 'vm-uuid': '64f1935f-104d-4f72-9e40-ea5335d775c1'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:40 user nova-compute[72620]: INFO os_vif [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6')
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:01:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:86:41:cc, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] No waiting events found dispatching network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:42 user nova-compute[72620]: WARNING nova.compute.manager [req-a47f47dc-ee2e-44ec-8dde-2616baf90da7 req-6071376c-ec3d-4641-b3bc-d7c1a3ae33a1 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received unexpected event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 for instance with vm_state building and task_state spawning.
Aug 09 21:01:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614904.907534, 64f1935f-104d-4f72-9e40-ea5335d775c1 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:01:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] VM Resumed (Lifecycle Event)
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:01:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance spawned successfully.
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] No waiting events found dispatching network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:44 user nova-compute[72620]: WARNING nova.compute.manager [req-6e98323d-7e00-4bbd-889a-64c4cbaa170b req-5ff8caf7-7b09-461c-b4ab-8e7c200e404b service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received unexpected event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 for instance with vm_state building and task_state spawning.
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:01:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691614904.91055, 64f1935f-104d-4f72-9e40-ea5335d775c1 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:01:44 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] VM Started (Lifecycle Event)
Aug 09 21:01:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:01:45 user nova-compute[72620]: INFO nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 09 21:01:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:01:45 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:01:45 user nova-compute[72620]: INFO nova.compute.manager [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Took 16.39 seconds to build instance.
Aug 09 21:01:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b2830cbb-2cb2-4a0e-be00-9c4deb2df81b tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.481s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:52 user nova-compute[72620]: INFO nova.compute.manager [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Terminating instance
Aug 09 21:01:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.compute.manager [req-34972c07-68ea-488a-9a42-d657c7dcc75a req-c11a6bde-b97f-4372-a105-7ac5a5ffb4ca service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-unplugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:01:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Instance destroyed successfully.
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.objects.instance [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid fbe8ab3e-6f7d-4820-8990-cdccac4f467f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:56:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1688400654',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1688400654',id=29,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:58:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-cs6z34fw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:00:07Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=fbe8ab3e-6f7d-4820-8990-cdccac4f467f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "40018e23-04bf-4343-af96-78cc24f74204", "address": "fa:16:3e:b0:8a:e6", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40018e23-04", "ovs_interfaceid": "40018e23-04bf-4343-af96-78cc24f74204", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_vif [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40018e23-04, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:01:53 user nova-compute[72620]: INFO os_vif [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8a:e6,bridge_name='br-int',has_traffic_filtering=True,id=40018e23-04bf-4343-af96-78cc24f74204,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40018e23-04')
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QwzhyMUe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:01:53 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c2a833-9a94-4968-956e-b6890b7c80f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31f00867-67a7-4635-8de0-6de5923072d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7858c-29d3-4251-9e3e-c2b00e0ec5d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31f00867-67a7-4635-8de0-6de5923072d2 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31f00867-67a7-4635-8de0-6de5923072d2 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31f00867-67a7-4635-8de0-6de5923072d2 (non-flash)
Aug 09 21:01:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30308160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b02f0-4c01-4f03-bea3-4f35d36fef58]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9160a-c68b-4db0-bfb0-710ec031925e]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5958805-b925-43b4-8e39-90bd1ffd3785]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Going to confirm migration 2 {{(pid=72620) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0952e4-87b0-4867-ae08-e6ccc5d2e083]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cca69b17', '/dev/disk/by-id/scsi-26138333363636664', '/dev/disk/by-id/scsi-1SCST_BIOcca69b17-a833ccfdb5d821fb') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5904a2-705e-467a-8d10-109ae76c4492]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec6635-be9c-4ccc-a950-9c7835f3ec48]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f453215-2d8b-40f3-b9b7-7ca7511eed8e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260]
Aug 09 21:01:53 user nova-compute[72620]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972, portal: 172.16.0.220,3260] successful.
Aug 09 21:01:53 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c7d7fdd-ec1a-45f9-8358-0d3e7c68c972 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa51fdc-0b9e-427f-a13e-3d13eb05c668]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== disconnect_volume: return (353ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:01:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Deleting instance files /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f_del
Aug 09 21:01:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Deletion of /opt/stack/data/nova/instances/fbe8ab3e-6f7d-4820-8990-cdccac4f467f_del complete
Aug 09 21:01:53 user nova-compute[72620]: INFO nova.compute.manager [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 09 21:01:53 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:01:53 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquired lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'info_cache' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:54 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Took 0.68 seconds to deallocate network for instance.
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-9ca788ed-fdbe-486c-976a-fb030e8f59ec req-43c21458-1ffb-44d3-a44b-1b510f4d03d0 service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-deleted-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [{"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Releasing lock "refresh_cache-66d3342a-c39e-4469-890f-3ac8934e8714" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'migration_context' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] Acquiring lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] No waiting events found dispatching network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:01:55 user nova-compute[72620]: WARNING nova.compute.manager [req-361637e5-9b82-4911-86bd-b8edf27638fe req-1095b4c5-4c48-4407-a9e8-e2ddffa2b9cd service nova] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Received unexpected event network-vif-plugged-40018e23-04bf-4343-af96-78cc24f74204 for instance with vm_state active and task_state deleting.
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.433s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:55 user nova-compute[72620]: INFO nova.compute.manager [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Took 0.81 seconds to detach 1 volumes for instance.
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:01:55 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Deleted allocation for migration 70490e38-fcca-4c76-9024-4dbad949d0bb
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-e3e43afc-dafc-4596-bd66-317ec9fd20fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.994s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:01:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:55 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Deleted allocations for instance fbe8ab3e-6f7d-4820-8990-cdccac4f467f
Aug 09 21:01:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-4be7ed84-ac5f-4da2-8a56-a4460d8b8992 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "fbe8ab3e-6f7d-4820-8990-cdccac4f467f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.355s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:01:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:01:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:02:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:02:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:04 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:02:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:08 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614913.4666028, fbe8ab3e-6f7d-4820-8990-cdccac4f467f => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:02:08 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] VM Stopped (Lifecycle Event)
Aug 09 21:02:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-82184d8b-8236-4528-8ed1-6975fc803194 None None] [instance: fbe8ab3e-6f7d-4820-8990-cdccac4f467f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:02:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:02:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:12 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:02:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:02:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7483MB free_disk=25.071983337402344GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fce385df-f5dd-4a0a-bdcc-916414124f48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 64f1935f-104d-4f72-9e40-ea5335d775c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance b9633463-fbae-481f-bcc9-ac784471eda4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:02:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:02:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:02:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-changed-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:02:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Refreshing instance network info cache due to event network-changed-fc822545-f704-4016-96fa-78889b3e26b7. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:02:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] Acquiring lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:02:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] Acquired lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:02:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Refreshing network info cache for port fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:02:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updated VIF entry in instance network info cache for port fc822545-f704-4016-96fa-78889b3e26b7. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:02:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updating instance_info_cache with network_info: [{"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:02:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-af6929f6-d27e-4580-ba53-82be7e0af4cf req-02dee964-b39a-42bc-aa7e-0fc528128dd0 service nova] Releasing lock "refresh_cache-fce385df-f5dd-4a0a-bdcc-916414124f48" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:02:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'flavor' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:02:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:31 user nova-compute[72620]: INFO nova.compute.manager [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Attaching volume 5f979fd3-fa75-4e3d-b296-2d2213fd8625 to /dev/vdb
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.utils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b47761-253e-4aa1-bfaf-4da6c7d66c45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23ab09-2ec1-45bf-9d79-6d0710f30d29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e995723-64cf-451a-9b2a-34e9cd146481]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db0678e-b182-4213-a96c-fd680c3adff5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:02:31 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:02:31 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aaab4a-c3b0-4cf7-8a29-bcdaea3d9614]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG os_brick.utils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:02:31 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updating existing volume attachment record: 6ddd2892-62ff-4a60-9b96-091052e9a396 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:02:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdXpnmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:02:40 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:02:40 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:02:40 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8908143-f5c3-4ffe-bf39-cb23f44e7617]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:02:40 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a235a1-aad8-4a47-b5aa-d982b382b9aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625] added
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0bead5-df8d-4a1b-b006-04c2d13c60b0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d60700-ce7f-42f7-bc9b-7a9e4e4f90b3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdXpnmco {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdXpnmco" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba0abb9-d98e-45c8-9fe2-12965df202b5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdXpnmco'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7c4399-58b2-4f09-b334-a324b7d8a6c4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[227732df-0a31-49e2-b44e-33ea653d4dc7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d67a5e-8b64-475d-a93c-1a5f30d58d2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260]
Aug 09 21:02:40 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260] successful.
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3078b9ce-07bf-4cf3-b5ae-fc27abb3830c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[45802c18-0723-45f2-b1cf-806b8236c432]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)
Aug 09 21:02:40 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[173c5807-fa56-4b93-8525-3d25ba747ccd]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:02:40 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdXpnmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:02:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:02:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26665653865396139', 'path': '/dev/sde'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:02:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665653865396139', 'path': '/dev/sde'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:02:41 user nova-compute[72620]: DEBUG nova.objects.instance [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'flavor' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:02:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:02:41 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:02:41 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 21:02:41 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:02:41 user nova-compute[72620]:   <serial>5f979fd3-fa75-4e3d-b296-2d2213fd8625</serial>
Aug 09 21:02:41 user nova-compute[72620]: </disk>
Aug 09 21:02:41 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:02:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:02:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:02:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] No VIF found with MAC fa:16:3e:91:d5:9e, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:02:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-afcc903d-73fa-4b32-adc2-c125d7c02ed5 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.158s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:43 user nova-compute[72620]: INFO nova.compute.manager [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Terminating instance
Aug 09 21:02:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-unplugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] No waiting events found dispatching network-vif-unplugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0405ced-9c40-40c0-bf8e-12d1d6b65b4b req-07ffdd24-ba0e-4be1-86d7-8ba98941007f service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-unplugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Instance destroyed successfully.
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.objects.instance [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:53:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1550160067',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1550160067',id=26,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:53:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-yhx5dtxo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:55:17Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=2ba125ef-76c1-44b7-a08c-bdbd7e378f90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "address": "fa:16:3e:ac:9f:c7", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d68f10e-08", "ovs_interfaceid": "2d68f10e-0895-468b-9cf8-ba0a32de4b1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG os_vif [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d68f10e-08, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:44 user nova-compute[72620]: INFO os_vif [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=2d68f10e-0895-468b-9cf8-ba0a32de4b1d,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d68f10e-08')
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Deleting instance files /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90_del
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Deletion of /opt/stack/data/nova/instances/2ba125ef-76c1-44b7-a08c-bdbd7e378f90_del complete
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.compute.manager [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.compute.manager [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Detaching volume 5f979fd3-fa75-4e3d-b296-2d2213fd8625
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.virt.block_device [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Attempting to driver detach volume 5f979fd3-fa75-4e3d-b296-2d2213fd8625 from mountpoint /dev/vdb
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Attempting to detach device vdb from instance fce385df-f5dd-4a0a-bdcc-916414124f48 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:02:44 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:02:44 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 21:02:44 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:02:44 user nova-compute[72620]:   <serial>5f979fd3-fa75-4e3d-b296-2d2213fd8625</serial>
Aug 09 21:02:44 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:02:44 user nova-compute[72620]: </disk>
Aug 09 21:02:44 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:02:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Successfully detached device vdb from instance fce385df-f5dd-4a0a-bdcc-916414124f48 from the persistent domain config.
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fce385df-f5dd-4a0a-bdcc-916414124f48 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:02:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:02:44 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:02:44 user nova-compute[72620]:   <source dev="/dev/sde"/>
Aug 09 21:02:44 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:02:44 user nova-compute[72620]:   <serial>5f979fd3-fa75-4e3d-b296-2d2213fd8625</serial>
Aug 09 21:02:44 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:02:44 user nova-compute[72620]: </disk>
Aug 09 21:02:44 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691614965.2477112, fce385df-f5dd-4a0a-bdcc-916414124f48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:02:45 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Took 0.65 seconds to deallocate network for instance.
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:02:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Successfully detached device vdb from instance fce385df-f5dd-4a0a-bdcc-916414124f48 from the live domain config.
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdXpnmco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:02:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[17426fc9-66cb-427e-b8d8-19bfb51cc16f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c999071d-2295-4cc7-ad37-d137fa21deef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)
Aug 09 21:02:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:02:45 user nova-compute[72620]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 (non-flash)
Aug 09 21:02:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c50409360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625'): ({'sde'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Removing single pathed devices sde {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc8fed7-ea95-40be-ba12-4252cf33a743]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f4f288-dc81-4267-9255-4bc6531a8a08]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Flushing IO for device /dev/sde {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5bea9a-ca7c-42b6-925c-8020657c580b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1e600-426c-46a9-940d-413822845018]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] SCSI volumes sde have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0420a4ba-925d-4aac-bd1d-cb4133ca87f9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a94f8-5dcd-47b2-996a-0a87371a4ee7]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260]
Aug 09 21:02:45 user nova-compute[72620]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625, portal: 172.16.0.220,3260] successful.
Aug 09 21:02:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f979fd3-fa75-4e3d-b296-2d2213fd8625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bcb69b-ab6f-4959-83b3-219843a1ba9c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] <== disconnect_volume: return (332ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:02:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:46 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Deleted allocations for instance 2ba125ef-76c1-44b7-a08c-bdbd7e378f90
Aug 09 21:02:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-60cf2edb-b022-40bf-92d8-fb429ba3d7be tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] Acquiring lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] Lock "2ba125ef-76c1-44b7-a08c-bdbd7e378f90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] No waiting events found dispatching network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:02:46 user nova-compute[72620]: WARNING nova.compute.manager [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received unexpected event network-vif-plugged-2d68f10e-0895-468b-9cf8-ba0a32de4b1d for instance with vm_state deleted and task_state None.
Aug 09 21:02:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-5ca2ee80-010c-4f0a-a1f0-7e43ae21d974 req-1cb8b04f-de44-431b-874c-7ee7d6c11dd0 service nova] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Received event network-vif-deleted-2d68f10e-0895-468b-9cf8-ba0a32de4b1d {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'flavor' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:02:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6c692241-cce2-44b3-a822-27ab93b3ca84 tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.937s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:02:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:02:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:02:59 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691614964.440774, 2ba125ef-76c1-44b7-a08c-bdbd7e378f90 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:02:59 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] VM Stopped (Lifecycle Event)
Aug 09 21:02:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dd06fbe1-380c-43d9-b119-6caa1e7e5f42 None None] [instance: 2ba125ef-76c1-44b7-a08c-bdbd7e378f90] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:02:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:03:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:05 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:03:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [{"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9cf87b7e-fd60-47df-b8ea-071fed88ca72" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:06 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:03:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:03:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:03:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:03:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:03:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7849MB free_disk=25.185951232910156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance fce385df-f5dd-4a0a-bdcc-916414124f48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 64f1935f-104d-4f72-9e40-ea5335d775c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance b9633463-fbae-481f-bcc9-ac784471eda4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:03:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:19 user nova-compute[72620]: INFO nova.compute.manager [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Terminating instance
Aug 09 21:03:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-unplugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] No waiting events found dispatching network-vif-unplugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-48c48923-340e-451e-8bfe-0daf51e3ef1a req-1ac8b861-937d-4aa6-b721-68d23699772a service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-unplugged-bfce28fe-062c-4340-b79e-afe43e52352e for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Instance destroyed successfully.
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'resources' on Instance uuid b9633463-fbae-481f-bcc9-ac784471eda4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-700982147',display_name='tempest-ServersNegativeTestJSON-server-700982147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-700982147',id=37,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:01:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-s453uzcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:01:37Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=b9633463-fbae-481f-bcc9-ac784471eda4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "bfce28fe-062c-4340-b79e-afe43e52352e", "address": "fa:16:3e:ee:b4:15", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfce28fe-06", "ovs_interfaceid": "bfce28fe-062c-4340-b79e-afe43e52352e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG os_vif [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfce28fe-06, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:20 user nova-compute[72620]: INFO os_vif [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:b4:15,bridge_name='br-int',has_traffic_filtering=True,id=bfce28fe-062c-4340-b79e-afe43e52352e,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfce28fe-06')
Aug 09 21:03:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Deleting instance files /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4_del
Aug 09 21:03:20 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Deletion of /opt/stack/data/nova/instances/b9633463-fbae-481f-bcc9-ac784471eda4_del complete
Aug 09 21:03:20 user nova-compute[72620]: INFO nova.compute.manager [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 09 21:03:20 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:03:20 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:21 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Took 1.24 seconds to deallocate network for instance.
Aug 09 21:03:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] Acquiring lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] Lock "b9633463-fbae-481f-bcc9-ac784471eda4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] No waiting events found dispatching network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:21 user nova-compute[72620]: WARNING nova.compute.manager [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received unexpected event network-vif-plugged-bfce28fe-062c-4340-b79e-afe43e52352e for instance with vm_state deleted and task_state None.
Aug 09 21:03:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-d322d1ae-3b20-45f1-87e1-504823a7ab06 req-8acedcf8-b085-4faf-ba61-1699d7a2b34f service nova] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Received event network-vif-deleted-bfce28fe-062c-4340-b79e-afe43e52352e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:22 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:22 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:22 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Deleted allocations for instance b9633463-fbae-481f-bcc9-ac784471eda4
Aug 09 21:03:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ab0d61d3-d580-4c41-b839-8adb842466a5 tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "b9633463-fbae-481f-bcc9-ac784471eda4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.587s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:23 user nova-compute[72620]: INFO nova.compute.manager [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Terminating instance
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Instance destroyed successfully.
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid 64f1935f-104d-4f72-9e40-ea5335d775c1 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1905103780',display_name='tempest-TestVolumeBootPattern-server-1905103780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1905103780',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-qskkz1mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:01:45Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=64f1935f-104d-4f72-9e40-ea5335d775c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG os_vif [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0e841b8-e6, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:23 user nova-compute[72620]: INFO os_vif [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:41:cc,bridge_name='br-int',has_traffic_filtering=True,id=d0e841b8-e6ef-44e5-b108-b2b125ee1bd6,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0e841b8-e6')
Aug 09 21:03:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:03:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:03:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:03:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e306d8-1c65-4819-a2bc-6abf12a0d424]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf66a30-01b8-433a-b286-c7538a27632e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:03:24 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:03:24 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:03:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:03:24 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:03:24 user nova-compute[72620]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:03:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c506ae440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-changed-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Refreshing instance network info cache due to event network-changed-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Acquiring lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Acquired lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Refreshing network info cache for port d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d8853-0345-4cd9-85d0-43a89856c815]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c1c45-557a-42a5-8d4c-310207ae380e]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33873ac-3a55-41be-9d2b-69dda1ca9d5a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb6cfa-c33f-4a68-ab8b-ad43ecce0c1c]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe48256fb-29090d22d8bcb34e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e48256fb', '/dev/disk/by-id/scsi-23239303930643232') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2706d9ef-268b-4601-b44b-bac74911a553]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35150dd-9132-4042-a007-01b8d879b0fd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b17284-a454-482a-8432-0e24fc293644]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]
Aug 09 21:03:24 user nova-compute[72620]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.
Aug 09 21:03:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7075fcec-49d6-41b4-b7d0-4231f777a3ba]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (307ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:03:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Deleting instance files /opt/stack/data/nova/instances/64f1935f-104d-4f72-9e40-ea5335d775c1_del
Aug 09 21:03:24 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Deletion of /opt/stack/data/nova/instances/64f1935f-104d-4f72-9e40-ea5335d775c1_del complete
Aug 09 21:03:24 user nova-compute[72620]: INFO nova.compute.manager [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 09 21:03:24 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:03:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updated VIF entry in instance network info cache for port d0e841b8-e6ef-44e5-b108-b2b125ee1bd6. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updating instance_info_cache with network_info: [{"id": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "address": "fa:16:3e:86:41:cc", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0e841b8-e6", "ovs_interfaceid": "d0e841b8-e6ef-44e5-b108-b2b125ee1bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Releasing lock "refresh_cache-64f1935f-104d-4f72-9e40-ea5335d775c1" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-unplugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] No waiting events found dispatching network-vif-unplugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-unplugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Acquiring lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] No waiting events found dispatching network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:25 user nova-compute[72620]: WARNING nova.compute.manager [req-869bff04-79a6-4b34-b4f8-125eae093add req-0fec3787-a260-417f-b0a3-fa2143b77cd7 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received unexpected event network-vif-plugged-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 for instance with vm_state active and task_state deleting.
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:25 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Took 0.87 seconds to deallocate network for instance.
Aug 09 21:03:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-2d208df8-5595-4599-8604-eae907b16210 req-30464817-645a-43c6-b603-4d6df0623276 service nova] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Received event network-vif-deleted-d0e841b8-e6ef-44e5-b108-b2b125ee1bd6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:26 user nova-compute[72620]: INFO nova.compute.manager [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Took 0.94 seconds to detach 1 volumes for instance.
Aug 09 21:03:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:26 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:26 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:26 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance 64f1935f-104d-4f72-9e40-ea5335d775c1
Aug 09 21:03:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce1bf66c-2f96-4847-9a9b-8bf277aeb11d tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "64f1935f-104d-4f72-9e40-ea5335d775c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.437s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:03:29 user nova-compute[72620]: INFO nova.compute.claims [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Claim successful on node user
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:03:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.policy [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bff591d26f9b4ebf93178b88c96fbe3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a2ad2cdd7144d01bd10765abff0eca9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:03:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Creating image(s)
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "/opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "/opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "/opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk 1073741824" returned: 0 in 0.051s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.127s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Cannot resize image /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'migration_context' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Ensure instance console log exists: /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Successfully created port: 9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Successfully updated port: 9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquired lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-changed-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Refreshing instance network info cache due to event network-changed-9306159f-4b6c-42ad-9957-ec355802357f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] Acquiring lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Releasing lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Instance network_info: |[{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] Acquired lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Refreshing network info cache for port 9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Start _get_guest_xml network_info=[{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:03:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:03:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-853822473',display_name='tempest-SnapshotDataIntegrityTests-server-853822473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-853822473',id=38,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbbNlTXyfJaPRSl90/xntX514MbB4ow7Dbh+kn3Z4agLJredm/BOcIbdAFN32+l8vX5Y+2IQCdxZ2BMKeuxlZcsDPrM4Tyq7Xc9m5sE1zi+Ls257xxTA9ZlQJrncPhCRA==',key_name='tempest-keypair-770968057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a2ad2cdd7144d01bd10765abff0eca9',ramdisk_id='',reservation_id='r-u3ghvezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1699967733',owner_user_name='tempest-SnapshotDataIntegrityTests-1699967733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff591d26f9b4ebf93178b88c96fbe3a',uuid=54aab7a9-83eb-43bc-ae55-8b3833abada3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converting VIF {"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'pci_devices' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:03:31 user nova-compute[72620]:   <uuid>54aab7a9-83eb-43bc-ae55-8b3833abada3</uuid>
Aug 09 21:03:31 user nova-compute[72620]:   <name>instance-00000026</name>
Aug 09 21:03:31 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:03:31 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:03:31 user nova-compute[72620]:   <metadata>
Aug 09 21:03:31 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:03:31 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-853822473</nova:name>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:03:31</nova:creationTime>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:03:31 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:03:31 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:owner>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:user uuid="bff591d26f9b4ebf93178b88c96fbe3a">tempest-SnapshotDataIntegrityTests-1699967733-project-member</nova:user>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:project uuid="0a2ad2cdd7144d01bd10765abff0eca9">tempest-SnapshotDataIntegrityTests-1699967733</nova:project>
Aug 09 21:03:31 user nova-compute[72620]:       </nova:owner>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:03:31 user nova-compute[72620]:       <nova:ports>
Aug 09 21:03:31 user nova-compute[72620]:         <nova:port uuid="9306159f-4b6c-42ad-9957-ec355802357f">
Aug 09 21:03:31 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 21:03:31 user nova-compute[72620]:         </nova:port>
Aug 09 21:03:31 user nova-compute[72620]:       </nova:ports>
Aug 09 21:03:31 user nova-compute[72620]:     </nova:instance>
Aug 09 21:03:31 user nova-compute[72620]:   </metadata>
Aug 09 21:03:31 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:03:31 user nova-compute[72620]:     <system>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="serial">54aab7a9-83eb-43bc-ae55-8b3833abada3</entry>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="uuid">54aab7a9-83eb-43bc-ae55-8b3833abada3</entry>
Aug 09 21:03:31 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:03:31 user nova-compute[72620]:     </system>
Aug 09 21:03:31 user nova-compute[72620]:   </sysinfo>
Aug 09 21:03:31 user nova-compute[72620]:   <os>
Aug 09 21:03:31 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:03:31 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:03:31 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:03:31 user nova-compute[72620]:   </os>
Aug 09 21:03:31 user nova-compute[72620]:   <features>
Aug 09 21:03:31 user nova-compute[72620]:     <acpi/>
Aug 09 21:03:31 user nova-compute[72620]:     <apic/>
Aug 09 21:03:31 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:03:31 user nova-compute[72620]:   </features>
Aug 09 21:03:31 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:03:31 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:03:31 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:03:31 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:03:31 user nova-compute[72620]:   </clock>
Aug 09 21:03:31 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:03:31 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:03:31 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:03:31 user nova-compute[72620]:   </cpu>
Aug 09 21:03:31 user nova-compute[72620]:   <devices>
Aug 09 21:03:31 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:03:31 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:03:31 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk"/>
Aug 09 21:03:31 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:03:31 user nova-compute[72620]:     </disk>
Aug 09 21:03:31 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:03:31 user nova-compute[72620]:       <mac address="fa:16:3e:81:de:e3"/>
Aug 09 21:03:31 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:03:31 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:03:31 user nova-compute[72620]:       <target dev="tap9306159f-4b"/>
Aug 09 21:03:31 user nova-compute[72620]:     </interface>
Aug 09 21:03:31 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:03:31 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/console.log" append="off"/>
Aug 09 21:03:31 user nova-compute[72620]:     </serial>
Aug 09 21:03:31 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:03:31 user nova-compute[72620]:     <video>
Aug 09 21:03:31 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:03:31 user nova-compute[72620]:     </video>
Aug 09 21:03:31 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:03:31 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:03:31 user nova-compute[72620]:     </rng>
Aug 09 21:03:31 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:03:31 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:03:31 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:03:31 user nova-compute[72620]:     </memballoon>
Aug 09 21:03:31 user nova-compute[72620]:   </devices>
Aug 09 21:03:31 user nova-compute[72620]: </domain>
Aug 09 21:03:31 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-853822473',display_name='tempest-SnapshotDataIntegrityTests-server-853822473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-853822473',id=38,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbbNlTXyfJaPRSl90/xntX514MbB4ow7Dbh+kn3Z4agLJredm/BOcIbdAFN32+l8vX5Y+2IQCdxZ2BMKeuxlZcsDPrM4Tyq7Xc9m5sE1zi+Ls257xxTA9ZlQJrncPhCRA==',key_name='tempest-keypair-770968057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a2ad2cdd7144d01bd10765abff0eca9',ramdisk_id='',reservation_id='r-u3ghvezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1699967733',owner_user_name='tempest-SnapshotDataIntegrityTests-1699967733-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff591d26f9b4ebf93178b88c96fbe3a',uuid=54aab7a9-83eb-43bc-ae55-8b3833abada3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converting VIF {"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG os_vif [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9306159f-4b, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9306159f-4b, col_values=(('external_ids', {'iface-id': '9306159f-4b6c-42ad-9957-ec355802357f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:de:e3', 'vm-uuid': '54aab7a9-83eb-43bc-ae55-8b3833abada3'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:31 user nova-compute[72620]: INFO os_vif [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b')
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:03:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No VIF found with MAC fa:16:3e:81:de:e3, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:03:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updated VIF entry in instance network info cache for port 9306159f-4b6c-42ad-9957-ec355802357f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:03:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9775af81-4739-494f-8655-6edef6e57ef6 req-04122a5d-9252-47d1-b4f5-55c7be8cc1a5 service nova] Releasing lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:03:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] No waiting events found dispatching network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:33 user nova-compute[72620]: WARNING nova.compute.manager [req-e0d0858d-4676-44fd-93a1-129a4a22b4a2 req-664c9b0d-b0bd-4c75-8e5f-72478479f739 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received unexpected event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f for instance with vm_state building and task_state spawning.
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:34 user nova-compute[72620]: INFO nova.compute.manager [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Terminating instance
Aug 09 21:03:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Instance destroyed successfully.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2062598968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2062598968',id=17,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:49:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-2vy0pz49',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:51:34Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=1e3f8155-89ec-4ba8-bb1d-cd5d656870b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "address": "fa:16:3e:ae:9c:42", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e5d2ea-0d", "ovs_interfaceid": "c5e5d2ea-0d2d-4243-bd26-0777a846d59b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_vif [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e5d2ea-0d, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:35 user nova-compute[72620]: INFO os_vif [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:9c:42,bridge_name='br-int',has_traffic_filtering=True,id=c5e5d2ea-0d2d-4243-bd26-0777a846d59b,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e5d2ea-0d')
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LQEZSXUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:03:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20ef07-fc05-451d-b823-8889959647c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa36bdf2-b58e-4b3e-b7f3-b99304df61c7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:03:35 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:03:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada (non-flash)
Aug 09 21:03:35 user nova-compute[72620]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:03:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3030b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b6169-d7ce-4cb6-b32e-2702804c0d52]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1991305c-0198-47a9-b46e-a38d273b1293]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7991e3-35e8-414b-a653-d01da889c25d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d2f47e-613a-4860-a027-6666a0f4381d]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[833fd4fc-bdd8-4fea-afe2-079ccc974bf2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0d59b-ad37-4fee-bd63-d7816b65c0e5]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260]
Aug 09 21:03:35 user nova-compute[72620]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada, portal: 172.16.0.220,3260] successful.
Aug 09 21:03:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] No waiting events found dispatching network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:35 user nova-compute[72620]: WARNING nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received unexpected event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f for instance with vm_state building and task_state spawning.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-unplugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Acquiring lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] No waiting events found dispatching network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:35 user nova-compute[72620]: WARNING nova.compute.manager [req-6a2fa865-8c8c-4d52-9fb1-df95ac97c2b1 req-6768725d-1dbe-4e21-b7e7-8a5eb879c71e service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received unexpected event network-vif-plugged-c5e5d2ea-0d2d-4243-bd26-0777a846d59b for instance with vm_state active and task_state deleting.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fea6a825-2021-4061-905b-a5a704d67ada -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d402eb46-4467-483c-8d2d-fbba45d5fcbc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615000.3887172, b9633463-fbae-481f-bcc9-ac784471eda4 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] VM Stopped (Lifecycle Event)
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] <== disconnect_volume: return (329ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Deleting instance files /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3_del
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Deletion of /opt/stack/data/nova/instances/1e3f8155-89ec-4ba8-bb1d-cd5d656870b3_del complete
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e0fea5f2-2639-4cf3-869e-db507dfc9b35 None None] [instance: b9633463-fbae-481f-bcc9-ac784471eda4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615015.495229, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] VM Resumed (Lifecycle Event)
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Instance spawned successfully.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615015.4971094, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] VM Started (Lifecycle Event)
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:35 user nova-compute[72620]: INFO nova.compute.manager [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Took 6.25 seconds to build instance.
Aug 09 21:03:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93e4f45d-d7db-4354-88f1-7f3c6af952dd tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.342s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:36 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:36 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Took 0.54 seconds to deallocate network for instance.
Aug 09 21:03:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-a9523398-66ca-4fb3-9770-0ad74a30c6e7 req-11c7a0f9-f4ac-4d01-b7cb-2278a83bdcdd service nova] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Received event network-vif-deleted-c5e5d2ea-0d2d-4243-bd26-0777a846d59b {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:36 user nova-compute[72620]: INFO nova.compute.manager [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 21:03:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:37 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:37 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Deleted allocations for instance 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3
Aug 09 21:03:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8a30596f-3628-4493-ba4d-916c09e21ee6 tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "1e3f8155-89ec-4ba8-bb1d-cd5d656870b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.985s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:38 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615003.9046082, 64f1935f-104d-4f72-9e40-ea5335d775c1 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:38 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] VM Stopped (Lifecycle Event)
Aug 09 21:03:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-78f4a3ac-3b30-4e0b-971a-44e7d1064155 None None] [instance: 64f1935f-104d-4f72-9e40-ea5335d775c1] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:41 user nova-compute[72620]: INFO nova.compute.manager [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Terminating instance
Aug 09 21:03:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-unplugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] No waiting events found dispatching network-vif-unplugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-720163de-d3cc-4b1b-b11d-4453ff044c2a req-0eb75d25-f8c6-41f2-a6f6-93c515fb6fa1 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-unplugged-fc822545-f704-4016-96fa-78889b3e26b7 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:03:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Instance destroyed successfully.
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lazy-loading 'resources' on Instance uuid fce385df-f5dd-4a0a-bdcc-916414124f48 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:00:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1948717016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1948717',id=35,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+AslKod0pMarHkGZfD8Wqbde9sJ/j71APr0A3qk+KOGpfqxU7hznN4uz+1KlFvXxzEf66jPihJ18ki2isApdMhoXo/Vocp+EUTEfhadsPy87eYJkYTtlowIqieH+WyzA==',key_name='tempest-keypair-745541158',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='480451d779014fc8ab7ded49e1c6695c',ramdisk_id='',reservation_id='r-zktz7l19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='caf15688989f4593abde969f30583860',uuid=fce385df-f5dd-4a0a-bdcc-916414124f48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converting VIF {"id": "fc822545-f704-4016-96fa-78889b3e26b7", "address": "fa:16:3e:91:d5:9e", "network": {"id": "4691a3de-7f0f-4a38-821e-88a305a5a151", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-868039308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "480451d779014fc8ab7ded49e1c6695c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfc822545-f7", "ovs_interfaceid": "fc822545-f704-4016-96fa-78889b3e26b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG os_vif [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfc822545-f7, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:03:42 user nova-compute[72620]: INFO os_vif [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:d5:9e,bridge_name='br-int',has_traffic_filtering=True,id=fc822545-f704-4016-96fa-78889b3e26b7,network=Network(4691a3de-7f0f-4a38-821e-88a305a5a151),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfc822545-f7')
Aug 09 21:03:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Deleting instance files /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48_del
Aug 09 21:03:42 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Deletion of /opt/stack/data/nova/instances/fce385df-f5dd-4a0a-bdcc-916414124f48_del complete
Aug 09 21:03:42 user nova-compute[72620]: INFO nova.compute.manager [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 09 21:03:42 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:03:42 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:03:44 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Took 1.38 seconds to deallocate network for instance.
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-a0a7adac-7cc7-4452-951b-9109328b6aa3 req-0e443f78-572d-4098-88a6-45db5eaaa013 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-deleted-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] Acquiring lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] No waiting events found dispatching network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:03:44 user nova-compute[72620]: WARNING nova.compute.manager [req-c35e7dcf-acaf-42bb-a6b9-7d7bd400e81d req-f297fa38-84b5-4d82-8e86-0563e41dd915 service nova] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Received unexpected event network-vif-plugged-fc822545-f704-4016-96fa-78889b3e26b7 for instance with vm_state deleted and task_state None.
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:44 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Deleted allocations for instance fce385df-f5dd-4a0a-bdcc-916414124f48
Aug 09 21:03:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-b5d3cb2c-c029-4991-95b3-b46a5e525fdf tempest-TestServerVolumeAttachScenarioOldVersion-488278334 tempest-TestServerVolumeAttachScenarioOldVersion-488278334-project-member] Lock "fce385df-f5dd-4a0a-bdcc-916414124f48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.943s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:03:45 user nova-compute[72620]: INFO nova.compute.manager [None req-cacdbf96-fccb-482c-9d07-a181cac81b87 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Get console output
Aug 09 21:03:45 user nova-compute[72620]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 09 21:03:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:50 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615015.0251062, 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:50 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] VM Stopped (Lifecycle Event)
Aug 09 21:03:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c5321ca9-966c-43d7-9374-1d9199d1b6da None None] [instance: 1e3f8155-89ec-4ba8-bb1d-cd5d656870b3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:03:57 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615022.6841748, fce385df-f5dd-4a0a-bdcc-916414124f48 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:03:57 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] VM Stopped (Lifecycle Event)
Aug 09 21:03:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f6ede6bc-9be1-47a6-a288-c2654280baf4 None None] [instance: fce385df-f5dd-4a0a-bdcc-916414124f48] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:03:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [{"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-bc81ba81-361a-4913-8aab-94e1849f992c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:04:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:04:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:04:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:04:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=25.210357666015625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 66d3342a-c39e-4469-890f-3ac8934e8714 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:14 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:04:14 user nova-compute[72620]: INFO nova.compute.claims [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Claim successful on node user
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:04:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:04:15 user nova-compute[72620]: INFO nova.virt.block_device [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Booting with volume 4f06b0a8-2394-49ca-99a4-102648900a33 at /dev/vda
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.policy [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.utils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea7a74-a808-4a1b-bec5-68832f978d2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7483f3-c484-49a9-a5ec-3ae5cf42af1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b56933-d0da-4393-a061-bcd22ea73320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[662aeb26-4210-474c-a90c-abe9a3465f6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:04:15 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:04:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6418d-24b7-44c1-a41a-a0d5571ca6fb]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG os_brick.utils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:04:15 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating existing volume attachment record: 55a07d0b-0624-410a-9001-304d591eaa39 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:04:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Successfully created port: c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:04:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Successfully updated port: c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing instance network info cache due to event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] Acquiring lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Instance network_info: |[{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] Acquired lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updated VIF entry in instance network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG nova.network.neutron [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5654a7e4-64c7-40d6-b52b-bd6effde01f6 req-e30b6683-d710-4197-a7b0-e0e5ed82f5a6 service nova] Releasing lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:04:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:04:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Creating image(s)
Aug 09 21:04:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Ensure instance console log exists: /opt/stack/data/nova/instances/26439232-cff4-4486-81aa-9c614fcbe097/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Start _get_guest_xml network_info=[{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26439232-cff4-4486-81aa-9c614fcbe097', 'attached_at': '', 'detached_at': '', 'volume_id': '4f06b0a8-2394-49ca-99a4-102648900a33', 'serial': '4f06b0a8-2394-49ca-99a4-102648900a33'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '55a07d0b-0624-410a-9001-304d591eaa39', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:04:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:04:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:04:24 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:04:24 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:04:24 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181a613-d1d5-4909-aa3c-43e1ccff8128]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:04:24 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbbc669-5ea2-4d53-9518-344024fb9bac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33] added
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be593a-a950-463f-81ad-4467027d2ede]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[70748a75-0409-4ff2-9e2d-34dcddce2f94]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZiqvhjM {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZiqvhjM" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2717e4e0-32ca-4552-9687-67b08e2eec08]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZiqvhjM'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74cce28-c3e7-49e5-bcdf-566f223c8c4f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8f89b-78ec-43d8-bb6e-70bb339f8fad]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86ad11-b865-43ab-ac9d-ebef16ce0d7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]
Aug 09 21:04:24 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201e298-c38a-4dea-bf70-5002113e49aa]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f6cf2a-a3a2-49fb-94bb-378bf9bddf72]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:24 user nova-compute[72620]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:24 user nova-compute[72620]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:04:24 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe9161-c440-4f87-9c37-e0607c752a9b]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:04:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:25 user nova-compute[72620]: INFO nova.compute.manager [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Terminating instance
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23239303930643232', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239303930643232', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322203433',display_name='tempest-TestVolumeBootPattern-server-322203433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322203433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-0q0hxtq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:04:15Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=26439232-cff4-4486-81aa-9c614fcbe097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid 26439232-cff4-4486-81aa-9c614fcbe097 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:04:25 user nova-compute[72620]:   <uuid>26439232-cff4-4486-81aa-9c614fcbe097</uuid>
Aug 09 21:04:25 user nova-compute[72620]:   <name>instance-00000027</name>
Aug 09 21:04:25 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:04:25 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:04:25 user nova-compute[72620]:   <metadata>
Aug 09 21:04:25 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:04:25 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:04:25 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-server-322203433</nova:name>
Aug 09 21:04:25 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:04:24</nova:creationTime>
Aug 09 21:04:25 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:04:25 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:04:25 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:04:25 user nova-compute[72620]:       <nova:owner>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 21:04:25 user nova-compute[72620]:       </nova:owner>
Aug 09 21:04:25 user nova-compute[72620]:       <nova:ports>
Aug 09 21:04:25 user nova-compute[72620]:         <nova:port uuid="c77b195a-58b5-42ff-b1fe-0979b88f5019">
Aug 09 21:04:25 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 21:04:25 user nova-compute[72620]:         </nova:port>
Aug 09 21:04:25 user nova-compute[72620]:       </nova:ports>
Aug 09 21:04:25 user nova-compute[72620]:     </nova:instance>
Aug 09 21:04:25 user nova-compute[72620]:   </metadata>
Aug 09 21:04:25 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:04:25 user nova-compute[72620]:     <system>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="serial">26439232-cff4-4486-81aa-9c614fcbe097</entry>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="uuid">26439232-cff4-4486-81aa-9c614fcbe097</entry>
Aug 09 21:04:25 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:04:25 user nova-compute[72620]:     </system>
Aug 09 21:04:25 user nova-compute[72620]:   </sysinfo>
Aug 09 21:04:25 user nova-compute[72620]:   <os>
Aug 09 21:04:25 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:04:25 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:04:25 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:04:25 user nova-compute[72620]:   </os>
Aug 09 21:04:25 user nova-compute[72620]:   <features>
Aug 09 21:04:25 user nova-compute[72620]:     <acpi/>
Aug 09 21:04:25 user nova-compute[72620]:     <apic/>
Aug 09 21:04:25 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:04:25 user nova-compute[72620]:   </features>
Aug 09 21:04:25 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:04:25 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:04:25 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:04:25 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:04:25 user nova-compute[72620]:   </clock>
Aug 09 21:04:25 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:04:25 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:04:25 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:04:25 user nova-compute[72620]:   </cpu>
Aug 09 21:04:25 user nova-compute[72620]:   <devices>
Aug 09 21:04:25 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:04:25 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:04:25 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 21:04:25 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:04:25 user nova-compute[72620]:       <serial>4f06b0a8-2394-49ca-99a4-102648900a33</serial>
Aug 09 21:04:25 user nova-compute[72620]:     </disk>
Aug 09 21:04:25 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:04:25 user nova-compute[72620]:       <mac address="fa:16:3e:5f:1f:a4"/>
Aug 09 21:04:25 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:04:25 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:04:25 user nova-compute[72620]:       <target dev="tapc77b195a-58"/>
Aug 09 21:04:25 user nova-compute[72620]:     </interface>
Aug 09 21:04:25 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:04:25 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/26439232-cff4-4486-81aa-9c614fcbe097/console.log" append="off"/>
Aug 09 21:04:25 user nova-compute[72620]:     </serial>
Aug 09 21:04:25 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:04:25 user nova-compute[72620]:     <video>
Aug 09 21:04:25 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:04:25 user nova-compute[72620]:     </video>
Aug 09 21:04:25 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:04:25 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:04:25 user nova-compute[72620]:     </rng>
Aug 09 21:04:25 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:04:25 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:04:25 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:04:25 user nova-compute[72620]:     </memballoon>
Aug 09 21:04:25 user nova-compute[72620]:   </devices>
Aug 09 21:04:25 user nova-compute[72620]: </domain>
Aug 09 21:04:25 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322203433',display_name='tempest-TestVolumeBootPattern-server-322203433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322203433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-0q0hxtq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:04:15Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=26439232-cff4-4486-81aa-9c614fcbe097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG os_vif [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc77b195a-58, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc77b195a-58, col_values=(('external_ids', {'iface-id': 'c77b195a-58b5-42ff-b1fe-0979b88f5019', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:1f:a4', 'vm-uuid': '26439232-cff4-4486-81aa-9c614fcbe097'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-321f4c83-d481-469f-ae88-a7a833e2e19c req-0ab2a1c1-3bb4-4234-bbbb-fb71dd30144b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: INFO os_vif [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58')
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:5f:1f:a4, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Instance destroyed successfully.
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lazy-loading 'resources' on Instance uuid 9cf87b7e-fd60-47df-b8ea-071fed88ca72 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-524310984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-524310984',id=13,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:44:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4f5de1122514369a2b3f71ae1146194',ramdisk_id='',reservation_id='r-ia0z2dlu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-45832372',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:46:43Z,user_data=None,user_id='1f794b9e72d4443e86ada7b257af84a3',uuid=9cf87b7e-fd60-47df-b8ea-071fed88ca72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converting VIF {"id": "5b43775c-c150-4ddd-9154-821de5d93d7f", "address": "fa:16:3e:ad:0c:04", "network": {"id": "edaf4154-6de5-4633-9748-43d84cc0f367", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-312372397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4f5de1122514369a2b3f71ae1146194", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43775c-c1", "ovs_interfaceid": "5b43775c-c150-4ddd-9154-821de5d93d7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG os_vif [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b43775c-c1, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: INFO os_vif [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:0c:04,bridge_name='br-int',has_traffic_filtering=True,id=5b43775c-c150-4ddd-9154-821de5d93d7f,network=Network(edaf4154-6de5-4633-9748-43d84cc0f367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43775c-c1')
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Deleting instance files /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72_del
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Deletion of /opt/stack/data/nova/instances/9cf87b7e-fd60-47df-b8ea-071fed88ca72_del complete
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.compute.manager [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 09 21:04:26 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Took 0.69 seconds to deallocate network for instance.
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-154c7fb4-ba76-45c2-9ec6-29cadbae5394 req-601a0a4a-f437-4c12-a499-af38dd0d76c8 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-deleted-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:26 user nova-compute[72620]: INFO nova.compute.manager [req-154c7fb4-ba76-45c2-9ec6-29cadbae5394 req-601a0a4a-f437-4c12-a499-af38dd0d76c8 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Neutron deleted interface 5b43775c-c150-4ddd-9154-821de5d93d7f; detaching it from the instance and deleting it from the info cache
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-154c7fb4-ba76-45c2-9ec6-29cadbae5394 req-601a0a4a-f437-4c12-a499-af38dd0d76c8 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-154c7fb4-ba76-45c2-9ec6-29cadbae5394 req-601a0a4a-f437-4c12-a499-af38dd0d76c8 service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Detach interface failed, port_id=5b43775c-c150-4ddd-9154-821de5d93d7f, reason: Instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Deleted allocations for instance 9cf87b7e-fd60-47df-b8ea-071fed88ca72
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] No waiting events found dispatching network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-a06e7073-55c8-4f80-973d-191e6e83df64 req-6f191666-abf9-45c2-b07c-b9136d9cb1f5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received unexpected event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 for instance with vm_state building and task_state spawning.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ed725272-2df0-40fa-920c-03552ccc8c3e tempest-ServerBootFromVolumeStableRescueTest-45832372 tempest-ServerBootFromVolumeStableRescueTest-45832372-project-member] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state deleted and task_state None.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state deleted and task_state None.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state deleted and task_state None.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-unplugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state deleted and task_state None.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Acquiring lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] Lock "9cf87b7e-fd60-47df-b8ea-071fed88ca72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] No waiting events found dispatching network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:27 user nova-compute[72620]: WARNING nova.compute.manager [req-ffff62d2-d28d-44b3-a096-8157488a97a9 req-1df1dcb7-c3a5-45ad-9b09-f5af4493cd5b service nova] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Received unexpected event network-vif-plugged-5b43775c-c150-4ddd-9154-821de5d93d7f for instance with vm_state deleted and task_state None.
Aug 09 21:04:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615069.105449, 26439232-cff4-4486-81aa-9c614fcbe097 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] VM Resumed (Lifecycle Event)
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Instance spawned successfully.
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615069.106646, 26439232-cff4-4486-81aa-9c614fcbe097 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] VM Started (Lifecycle Event)
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Took 5.23 seconds to spawn the instance on the hypervisor.
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:04:29 user nova-compute[72620]: INFO nova.compute.manager [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Took 14.36 seconds to build instance.
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] No waiting events found dispatching network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:29 user nova-compute[72620]: WARNING nova.compute.manager [req-1383381f-2b5d-47c3-ad6d-61730b332bfa req-74297906-430e-429c-a0d8-a6812a5508ea service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received unexpected event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 for instance with vm_state active and task_state None.
Aug 09 21:04:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e743d7f-9d15-4f4d-9b83-7fa2a3dbfefd tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.463s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:41 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615066.0171497, 9cf87b7e-fd60-47df-b8ea-071fed88ca72 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:04:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] VM Stopped (Lifecycle Event)
Aug 09 21:04:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-91cade74-6d57-4ca7-ba2d-2d637d283fad None None] [instance: 9cf87b7e-fd60-47df-b8ea-071fed88ca72] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:04:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:45 user nova-compute[72620]: INFO nova.compute.manager [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Terminating instance
Aug 09 21:04:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-a26789cc-f0f3-4f61-b96d-79712dfeffcb req-e05575c3-fd44-400a-ab43-35f67cae776f service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-unplugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Instance destroyed successfully.
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'resources' on Instance uuid 66d3342a-c39e-4469-890f-3ac8934e8714 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1106592924',display_name='tempest-ServerActionsTestOtherA-server-1106592924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1106592924',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-vesivwdv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:01:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=66d3342a-c39e-4469-890f-3ac8934e8714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "3c571ba7-c628-4dda-838a-4675f8c56611", "address": "fa:16:3e:ff:99:38", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c571ba7-c6", "ovs_interfaceid": "3c571ba7-c628-4dda-838a-4675f8c56611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_vif [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c571ba7-c6, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:04:46 user nova-compute[72620]: INFO os_vif [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:99:38,bridge_name='br-int',has_traffic_filtering=True,id=3c571ba7-c628-4dda-838a-4675f8c56611,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c571ba7-c6')
Aug 09 21:04:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZzXFpqWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:04:46 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3493197-6689-4252-900c-1851240397d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc3580-e469-4ba3-a645-e8c4ce9aa740]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:46 user nova-compute[72620]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:04:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc (non-flash)
Aug 09 21:04:46 user nova-compute[72620]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:04:46 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30589a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f256c-5b64-4803-86c3-c3fca27c2b7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d478b32-be74-4852-b915-fd7b8aac8d87]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb8b26e-6bb9-46ed-ac91-b5a19b223b0a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1ada89-449d-4684-a349-454dd3c69367]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIObdc45c8a-cd3a90632fcab73c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bdc45c8a', '/dev/disk/by-id/scsi-26364336139303633') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:04:46 user nova-compute[72620]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObdc45c8a-cd3a90632fcab73c
Aug 09 21:04:46 user nova-compute[72620]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bdc45c8a
Aug 09 21:04:46 user nova-compute[72620]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26364336139303633
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e63f2a-fa05-47b4-a380-afeb69f4c5e5]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1a771-7b37-4614-86f8-4f413b7e1701]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d86fe0-813f-44a2-8ff4-ee5c8a14941c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260]
Aug 09 21:04:47 user nova-compute[72620]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc, portal: 172.16.0.220,3260] successful.
Aug 09 21:04:47 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f369b-8c1f-4b14-af1f-80e40d3ad9e3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] <== disconnect_volume: return (324ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:04:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Deleting instance files /opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714_del
Aug 09 21:04:47 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Deletion of /opt/stack/data/nova/instances/66d3342a-c39e-4469-890f-3ac8934e8714_del complete
Aug 09 21:04:47 user nova-compute[72620]: INFO nova.compute.manager [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 09 21:04:47 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:04:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] Acquiring lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] Lock "66d3342a-c39e-4469-890f-3ac8934e8714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] No waiting events found dispatching network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:04:48 user nova-compute[72620]: WARNING nova.compute.manager [req-14f42467-2624-4f26-a1e6-dbf8f53d67ea req-93c71175-d5b7-4b95-b10d-b0e160202803 service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received unexpected event network-vif-plugged-3c571ba7-c628-4dda-838a-4675f8c56611 for instance with vm_state active and task_state deleting.
Aug 09 21:04:49 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:04:49 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Took 2.27 seconds to deallocate network for instance.
Aug 09 21:04:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-c92a6c5c-f0ea-4db6-8e9a-1ddb1340346c req-14b59a61-04c8-4d45-a9c9-c6b583fc4efa service nova] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Received event network-vif-deleted-3c571ba7-c628-4dda-838a-4675f8c56611 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:04:50 user nova-compute[72620]: INFO nova.compute.manager [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Took 0.87 seconds to detach 1 volumes for instance.
Aug 09 21:04:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Deleting volume: fec5eeeb-6ee4-4f85-82c8-95ecdd71f6fc {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:50 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Deleted allocations for instance 66d3342a-c39e-4469-890f-3ac8934e8714
Aug 09 21:04:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ddcee26d-bd76-4c37-94f8-2719dc12b3fc tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "66d3342a-c39e-4469-890f-3ac8934e8714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.788s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:04:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:04:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:01 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615086.6885338, 66d3342a-c39e-4469-890f-3ac8934e8714 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:01 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] VM Stopped (Lifecycle Event)
Aug 09 21:05:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-9a6b1606-cc66-42d9-b65c-77ad7a2604af None None] [instance: 66d3342a-c39e-4469-890f-3ac8934e8714] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:07 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updating instance_info_cache with network_info: [{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:08 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:05:08 user nova-compute[72620]: INFO nova.compute.claims [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Claim successful on node user
Aug 09 21:05:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:05:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:05:09 user nova-compute[72620]: INFO nova.virt.block_device [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Booting with volume 980f76d7-d3be-4399-b616-c4e3351d8f79 at /dev/vda
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.policy [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c8503e2bd8547d7b99ef24d6fd8398d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4efc6fd7914d4901ad11164be89ce3b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.utils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[65185019-c2fa-40af-b2b3-d82fab148157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29a0ffb-3558-41cb-aa7f-6c4f62e80ba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad32e5be-5732-4ee9-9597-e80b8c08f1af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5dcf8-e176-46aa-9844-14e282a4bfde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:05:09 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:05:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[449d736d-21c3-46e9-9e4b-010487e051af]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG os_brick.utils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:05:09 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating existing volume attachment record: bd508e06-97a3-402d-8b4d-f45ae00b5556 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Successfully created port: 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Successfully updated port: 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing instance network info cache due to event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG nova.network.neutron [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance network_info: |[{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updated VIF entry in instance network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71c1779d-251a-421f-8ae9-65625215ae01 req-8a59564f-2bda-4084-be05-c0f28df3a30c service nova] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:05:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:14 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.331443786621094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance bc81ba81-361a-4913-8aab-94e1849f992c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 26439232-cff4-4486-81aa-9c614fcbe097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:05:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:05:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:05:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:05:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Creating image(s)
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Ensure instance console log exists: /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start _get_guest_xml network_info=[{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c', 'attached_at': '', 'detached_at': '', 'volume_id': '980f76d7-d3be-4399-b616-c4e3351d8f79', 'serial': '980f76d7-d3be-4399-b616-c4e3351d8f79'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'bd508e06-97a3-402d-8b4d-f45ae00b5556', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:05:17 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:17 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:05:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:05:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:05:17 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb3dd16-e251-4b15-9472-f72744f5814f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:05:17 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06211fd-a277-421c-b57c-9bdfaf038847]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79] added
Aug 09 21:05:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8fe4c0-1c3f-409a-88f5-c791a5517139]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9e25d-c19b-45b9-ae28-ad087acfdb07]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCSrNmPT {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCSrNmPT" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c7bae9-da6c-4e7b-8fbd-02a5bd8623cf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCSrNmPT'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ac036-e792-482e-a90d-d432cb44c799]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4a085c-149e-4af1-81b0-66708f3cd150]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c723aa1-c6a5-465a-b0b7-5e6be663be24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]
Aug 09 21:05:17 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.
Aug 09 21:05:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[404a199d-094a-4191-b234-508c92d1bee3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ca8804-ddd8-4227-94cd-a1c3ae1b17ed]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:18 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:18 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:18 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79a7149-aad4-41cf-9936-a836fc43b9c3]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:05:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23838613931306463', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838613931306463', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3HvjLT8m8blvWfC2jHWiOs5voJLbdry4tOgEM857ySi4jGg+2TpSgeUMb8MBXrKIpjSmVxBY7p76+GLrOsAaSg0x31EBn17X3RdRsOMn66L6vIFATbM9jky1qtLd/Gng==',key_name='tempest-TestShelveInstance-1479066823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:05:09Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:05:19 user nova-compute[72620]:   <uuid>3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</uuid>
Aug 09 21:05:19 user nova-compute[72620]:   <name>instance-00000028</name>
Aug 09 21:05:19 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:05:19 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:05:19 user nova-compute[72620]:   <metadata>
Aug 09 21:05:19 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:05:19 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:05:19 user nova-compute[72620]:       <nova:name>tempest-TestShelveInstance-server-831123716</nova:name>
Aug 09 21:05:19 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:05:17</nova:creationTime>
Aug 09 21:05:19 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:05:19 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:05:19 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:05:19 user nova-compute[72620]:       <nova:owner>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:user uuid="5c8503e2bd8547d7b99ef24d6fd8398d">tempest-TestShelveInstance-413923288-project-member</nova:user>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:project uuid="4efc6fd7914d4901ad11164be89ce3b1">tempest-TestShelveInstance-413923288</nova:project>
Aug 09 21:05:19 user nova-compute[72620]:       </nova:owner>
Aug 09 21:05:19 user nova-compute[72620]:       <nova:ports>
Aug 09 21:05:19 user nova-compute[72620]:         <nova:port uuid="66740ed3-6c0e-4436-b8cc-1091f0925a83">
Aug 09 21:05:19 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 21:05:19 user nova-compute[72620]:         </nova:port>
Aug 09 21:05:19 user nova-compute[72620]:       </nova:ports>
Aug 09 21:05:19 user nova-compute[72620]:     </nova:instance>
Aug 09 21:05:19 user nova-compute[72620]:   </metadata>
Aug 09 21:05:19 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:05:19 user nova-compute[72620]:     <system>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="serial">3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</entry>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="uuid">3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</entry>
Aug 09 21:05:19 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:05:19 user nova-compute[72620]:     </system>
Aug 09 21:05:19 user nova-compute[72620]:   </sysinfo>
Aug 09 21:05:19 user nova-compute[72620]:   <os>
Aug 09 21:05:19 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:05:19 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:05:19 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:05:19 user nova-compute[72620]:   </os>
Aug 09 21:05:19 user nova-compute[72620]:   <features>
Aug 09 21:05:19 user nova-compute[72620]:     <acpi/>
Aug 09 21:05:19 user nova-compute[72620]:     <apic/>
Aug 09 21:05:19 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:05:19 user nova-compute[72620]:   </features>
Aug 09 21:05:19 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:05:19 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:05:19 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:05:19 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:05:19 user nova-compute[72620]:   </clock>
Aug 09 21:05:19 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:05:19 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:05:19 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:05:19 user nova-compute[72620]:   </cpu>
Aug 09 21:05:19 user nova-compute[72620]:   <devices>
Aug 09 21:05:19 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:05:19 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:05:19 user nova-compute[72620]:       <source dev="/dev/sdc"/>
Aug 09 21:05:19 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:05:19 user nova-compute[72620]:       <serial>980f76d7-d3be-4399-b616-c4e3351d8f79</serial>
Aug 09 21:05:19 user nova-compute[72620]:     </disk>
Aug 09 21:05:19 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:05:19 user nova-compute[72620]:       <mac address="fa:16:3e:f3:78:f9"/>
Aug 09 21:05:19 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:05:19 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:05:19 user nova-compute[72620]:       <target dev="tap66740ed3-6c"/>
Aug 09 21:05:19 user nova-compute[72620]:     </interface>
Aug 09 21:05:19 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:05:19 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c/console.log" append="off"/>
Aug 09 21:05:19 user nova-compute[72620]:     </serial>
Aug 09 21:05:19 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:05:19 user nova-compute[72620]:     <video>
Aug 09 21:05:19 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:05:19 user nova-compute[72620]:     </video>
Aug 09 21:05:19 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:05:19 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:05:19 user nova-compute[72620]:     </rng>
Aug 09 21:05:19 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:05:19 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:05:19 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:05:19 user nova-compute[72620]:     </memballoon>
Aug 09 21:05:19 user nova-compute[72620]:   </devices>
Aug 09 21:05:19 user nova-compute[72620]: </domain>
Aug 09 21:05:19 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3HvjLT8m8blvWfC2jHWiOs5voJLbdry4tOgEM857ySi4jGg+2TpSgeUMb8MBXrKIpjSmVxBY7p76+GLrOsAaSg0x31EBn17X3RdRsOMn66L6vIFATbM9jky1qtLd/Gng==',key_name='tempest-TestShelveInstance-1479066823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:05:09Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG os_vif [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66740ed3-6c, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66740ed3-6c, col_values=(('external_ids', {'iface-id': '66740ed3-6c0e-4436-b8cc-1091f0925a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:78:f9', 'vm-uuid': '3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:19 user nova-compute[72620]: INFO os_vif [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c')
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:05:19 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] No VIF found with MAC fa:16:3e:f3:78:f9, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-changed-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Refreshing instance network info cache due to event network-changed-9306159f-4b6c-42ad-9957-ec355802357f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] Acquiring lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] Acquired lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG nova.network.neutron [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Refreshing network info cache for port 9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:20 user nova-compute[72620]: WARNING nova.compute.manager [req-df91e0ee-2b93-46ac-9532-4303bd33d097 req-dd0c6da1-4653-4866-a332-e6cd532bad0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state building and task_state spawning.
Aug 09 21:05:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updated VIF entry in instance network info cache for port 9306159f-4b6c-42ad-9957-ec355802357f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:05:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-984315ef-d180-41c5-baae-95f211da28d5 req-e7f9a33e-8f30-4006-861e-e20dc10ae017 service nova] Releasing lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615122.5718307, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Resumed (Lifecycle Event)
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance spawned successfully.
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615122.5748892, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Started (Lifecycle Event)
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:22 user nova-compute[72620]: WARNING nova.compute.manager [req-973bec36-790d-4c43-b340-abc1c4bb1622 req-3cae2052-31e3-4e42-ba78-97966c5fe8e7 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state building and task_state spawning.
Aug 09 21:05:22 user nova-compute[72620]: INFO nova.compute.manager [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Took 14.05 seconds to build instance.
Aug 09 21:05:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-dfbc0d6f-7d5b-429b-8cf3-f256b523451d tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.141s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:25 user nova-compute[72620]: INFO nova.compute.manager [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attaching volume 7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 to /dev/vdb
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.utils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1cd41-3e02-4416-816e-a2cabca2b978]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde1e6ab-b841-4497-9c32-31eea9a061b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[389aba6e-fb1b-4154-b171-0c63b73c2367]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ed20a-a8ea-494d-8d74-81f29f255d26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:05:25 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:05:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb98e1c7-44c1-4fc6-859c-b3df201c0e92]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG os_brick.utils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:05:25 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating existing volume attachment record: a67f4023-4808-4923-93a5-cb9d429a942f {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:05:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:05:30 user nova-compute[72620]: INFO nova.compute.claims [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Claim successful on node user
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:05:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.policy [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321c1c40fcf24714ad1c224351ff217e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75043330db1b414d8ad64a41a5bf7fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:05:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Creating image(s)
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk 1073741824" returned: 0 in 0.056s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Successfully created port: ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Cannot resize image /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'migration_context' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Ensure instance console log exists: /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Successfully updated port: ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing instance network info cache due to event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance network_info: |[{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start _get_guest_xml network_info=[{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:05:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:32 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTS+9HyWtzG8zzYFJ5yEiELG8nmunC2LTFfSkxG7p5Ymt0M6e8zP/9RQ+OdEvUTnG0bRvEEPNpuptha4KyQq4rJ0CXRdiCxBIwOyOftihc1G7lNara27YCa5tes9I0lbQ==',key_name='tempest-keypair-629849260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_devices' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:05:32 user nova-compute[72620]:   <uuid>6070294c-4df8-45cc-8d89-128df66bf0d4</uuid>
Aug 09 21:05:32 user nova-compute[72620]:   <name>instance-00000029</name>
Aug 09 21:05:32 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:05:32 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:05:32 user nova-compute[72620]:   <metadata>
Aug 09 21:05:32 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:05:32 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-700966194</nova:name>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:05:32</nova:creationTime>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:05:32 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:05:32 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:owner>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:user uuid="321c1c40fcf24714ad1c224351ff217e">tempest-AttachVolumeShelveTestJSON-1153095829-project-member</nova:user>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:project uuid="75043330db1b414d8ad64a41a5bf7fc6">tempest-AttachVolumeShelveTestJSON-1153095829</nova:project>
Aug 09 21:05:32 user nova-compute[72620]:       </nova:owner>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:05:32 user nova-compute[72620]:       <nova:ports>
Aug 09 21:05:32 user nova-compute[72620]:         <nova:port uuid="ae913f60-005d-47f6-8cfe-9fcb620449f6">
Aug 09 21:05:32 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 21:05:32 user nova-compute[72620]:         </nova:port>
Aug 09 21:05:32 user nova-compute[72620]:       </nova:ports>
Aug 09 21:05:32 user nova-compute[72620]:     </nova:instance>
Aug 09 21:05:32 user nova-compute[72620]:   </metadata>
Aug 09 21:05:32 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:05:32 user nova-compute[72620]:     <system>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="serial">6070294c-4df8-45cc-8d89-128df66bf0d4</entry>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="uuid">6070294c-4df8-45cc-8d89-128df66bf0d4</entry>
Aug 09 21:05:32 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:05:32 user nova-compute[72620]:     </system>
Aug 09 21:05:32 user nova-compute[72620]:   </sysinfo>
Aug 09 21:05:32 user nova-compute[72620]:   <os>
Aug 09 21:05:32 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:05:32 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:05:32 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:05:32 user nova-compute[72620]:   </os>
Aug 09 21:05:32 user nova-compute[72620]:   <features>
Aug 09 21:05:32 user nova-compute[72620]:     <acpi/>
Aug 09 21:05:32 user nova-compute[72620]:     <apic/>
Aug 09 21:05:32 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:05:32 user nova-compute[72620]:   </features>
Aug 09 21:05:32 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:05:32 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:05:32 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:05:32 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:05:32 user nova-compute[72620]:   </clock>
Aug 09 21:05:32 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:05:32 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:05:32 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:05:32 user nova-compute[72620]:   </cpu>
Aug 09 21:05:32 user nova-compute[72620]:   <devices>
Aug 09 21:05:32 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:05:32 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:05:32 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk"/>
Aug 09 21:05:32 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:05:32 user nova-compute[72620]:     </disk>
Aug 09 21:05:32 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:05:32 user nova-compute[72620]:       <mac address="fa:16:3e:16:a7:40"/>
Aug 09 21:05:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:05:32 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:05:32 user nova-compute[72620]:       <target dev="tapae913f60-00"/>
Aug 09 21:05:32 user nova-compute[72620]:     </interface>
Aug 09 21:05:32 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:05:32 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/console.log" append="off"/>
Aug 09 21:05:32 user nova-compute[72620]:     </serial>
Aug 09 21:05:32 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:05:32 user nova-compute[72620]:     <video>
Aug 09 21:05:32 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:05:32 user nova-compute[72620]:     </video>
Aug 09 21:05:32 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:05:32 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:05:32 user nova-compute[72620]:     </rng>
Aug 09 21:05:32 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:05:32 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:05:32 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:05:32 user nova-compute[72620]:     </memballoon>
Aug 09 21:05:32 user nova-compute[72620]:   </devices>
Aug 09 21:05:32 user nova-compute[72620]: </domain>
Aug 09 21:05:32 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTS+9HyWtzG8zzYFJ5yEiELG8nmunC2LTFfSkxG7p5Ymt0M6e8zP/9RQ+OdEvUTnG0bRvEEPNpuptha4KyQq4rJ0CXRdiCxBIwOyOftihc1G7lNara27YCa5tes9I0lbQ==',key_name='tempest-keypair-629849260',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG os_vif [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae913f60-00, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae913f60-00, col_values=(('external_ids', {'iface-id': 'ae913f60-005d-47f6-8cfe-9fcb620449f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a7:40', 'vm-uuid': '6070294c-4df8-45cc-8d89-128df66bf0d4'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:05:32 user nova-compute[72620]: INFO os_vif [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00')
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No VIF found with MAC fa:16:3e:16:a7:40, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updated VIF entry in instance network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:05:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0ac50ae3-9d82-48e3-82ec-3b38ff129691 req-ec4fc13d-5589-4eb3-8538-3ec9f8d5be97 service nova] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:05:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:34 user nova-compute[72620]: WARNING nova.compute.manager [req-03a386d1-b47b-4563-a4fb-dab153234805 req-0292b7a7-6f35-4d90-bbdd-bfbe54070a47 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state building and task_state spawning.
Aug 09 21:05:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkzbyDQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:05:34 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:05:34 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:05:34 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ede0c-f2c3-44f9-ab3d-2fdb3ab1c662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:05:34 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc42f2-f1a2-4edd-9939-8f929ed95f1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8] added
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1411108f-2f1e-4ac6-9cd6-326f98d93052]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e953d6-dd5a-45ff-99cc-6a325d70c672]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkzbyDQh {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkzbyDQh" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c7783-09ee-4c46-a891-3f79477a68c2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkzbyDQh'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[42771f3e-1c8b-48a9-87a4-7a153152a1cc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6ee028-8579-4d95-9a1c-69574f8db916]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fb0a4-d11e-4a74-90ac-61edab3cec6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260]
Aug 09 21:05:34 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260] successful.
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebfbdaa-4cb2-4fa4-bf87-b1e8cbfc17c1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ee215-cd57-42d8-a61f-9f093c7913d6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)
Aug 09 21:05:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026cacf-fa9a-40b4-8765-0f835e1d4d37]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:05:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkzbyDQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:05:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:05:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23265366638313933', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:05:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265366638313933', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:05:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:05:35 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:05:35 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 21:05:35 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:05:35 user nova-compute[72620]:   <serial>7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8</serial>
Aug 09 21:05:35 user nova-compute[72620]: </disk>
Aug 09 21:05:35 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No VIF found with MAC fa:16:3e:81:de:e3, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615136.3146284, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Resumed (Lifecycle Event)
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance spawned successfully.
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615136.3168476, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Started (Lifecycle Event)
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:36 user nova-compute[72620]: WARNING nova.compute.manager [req-acb73423-90e3-4ec4-85c2-3980a8c33660 req-be4a639e-a262-4992-a1c6-58f15c60b6c5 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state building and task_state spawning.
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:05:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c5679a82-2007-4fb9-81f0-36c86f557837 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.046s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 09 21:05:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:36 user nova-compute[72620]: INFO nova.compute.manager [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Took 6.45 seconds to build instance.
Aug 09 21:05:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-aa481886-7c03-4ebb-bd97-94791e330b00 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.581s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:43 user nova-compute[72620]: INFO nova.compute.manager [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Terminating instance
Aug 09 21:05:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-69ae95c3-7229-4dde-b72b-9bab55a28927 req-923a971a-8780-4e7e-beef-4c12cdf7ab76 service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-unplugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:05:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Instance destroyed successfully.
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lazy-loading 'resources' on Instance uuid bc81ba81-361a-4913-8aab-94e1849f992c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T20:49:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1955171695',display_name='tempest-ServerActionsTestOtherA-server-1867424062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1955171695',id=20,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXKvk8ikxEb+GoiSo2/usbW512Ym2L59eYu71qKvPDRMIFsN71qCS0Axb9rNSLrPegIaa/K0fkk5wpI07VEY2jsrQ699g640/3xuPAAcEP/1uH+7FHue1upWvLvuvWKrA==',key_name='tempest-keypair-1803099818',keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:53:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80ded0dc696e4bd6b25a57202b956d63',ramdisk_id='',reservation_id='r-7n788spt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-763482691',owner_user_name='tempest-ServerActionsTestOtherA-763482691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:53:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1546466d62a6410c83fa85f1b0c8b934',uuid=bc81ba81-361a-4913-8aab-94e1849f992c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converting VIF {"id": "0204bf3f-57ea-46ae-a128-69fb487866ff", "address": "fa:16:3e:55:3f:3f", "network": {"id": "5119be40-2ec7-4eb9-9464-67d2402fa40d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-153758314-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80ded0dc696e4bd6b25a57202b956d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0204bf3f-57", "ovs_interfaceid": "0204bf3f-57ea-46ae-a128-69fb487866ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG os_vif [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0204bf3f-57, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:05:44 user nova-compute[72620]: INFO os_vif [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:3f:3f,bridge_name='br-int',has_traffic_filtering=True,id=0204bf3f-57ea-46ae-a128-69fb487866ff,network=Network(5119be40-2ec7-4eb9-9464-67d2402fa40d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0204bf3f-57')
Aug 09 21:05:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Deleting instance files /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c_del
Aug 09 21:05:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Deletion of /opt/stack/data/nova/instances/bc81ba81-361a-4913-8aab-94e1849f992c_del complete
Aug 09 21:05:44 user nova-compute[72620]: INFO nova.compute.manager [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 09 21:05:44 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:05:44 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:05:45 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Took 0.72 seconds to deallocate network for instance.
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:45 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Deleted allocations for instance bc81ba81-361a-4913-8aab-94e1849f992c
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f76625c2-f709-423e-85c5-8a37cbbf29a7 tempest-ServerActionsTestOtherA-763482691 tempest-ServerActionsTestOtherA-763482691-project-member] Lock "bc81ba81-361a-4913-8aab-94e1849f992c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] Acquiring lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] Lock "bc81ba81-361a-4913-8aab-94e1849f992c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] No waiting events found dispatching network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:05:45 user nova-compute[72620]: WARNING nova.compute.manager [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received unexpected event network-vif-plugged-0204bf3f-57ea-46ae-a128-69fb487866ff for instance with vm_state deleted and task_state None.
Aug 09 21:05:45 user nova-compute[72620]: DEBUG nova.compute.manager [req-da5196c3-d805-4a19-a7b6-feaa152fff9d req-5be2e7c6-ac0b-4d00-a994-0ced46324f0e service nova] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Received event network-vif-deleted-0204bf3f-57ea-46ae-a128-69fb487866ff {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:05:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:05:59 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615144.2514312, bc81ba81-361a-4913-8aab-94e1849f992c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:05:59 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] VM Stopped (Lifecycle Event)
Aug 09 21:05:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-098b7753-d691-497e-add9-09edafc0e241 None None] [instance: bc81ba81-361a-4913-8aab-94e1849f992c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:05:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:01 user nova-compute[72620]: INFO nova.compute.manager [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Detaching volume 7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8
Aug 09 21:06:01 user nova-compute[72620]: INFO nova.virt.block_device [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attempting to driver detach volume 7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 from mountpoint /dev/vdb
Aug 09 21:06:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Attempting to detach device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:06:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:06:01 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:06:01 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 21:06:01 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:06:01 user nova-compute[72620]:   <serial>7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8</serial>
Aug 09 21:06:01 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:06:01 user nova-compute[72620]: </disk>
Aug 09 21:06:01 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:06:01 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config.
Aug 09 21:06:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:06:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:06:01 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:06:01 user nova-compute[72620]:   <source dev="/dev/sdd"/>
Aug 09 21:06:01 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:06:01 user nova-compute[72620]:   <serial>7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8</serial>
Aug 09 21:06:01 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:06:01 user nova-compute[72620]: </disk>
Aug 09 21:06:01 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615162.034379, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:06:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config.
Aug 09 21:06:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkzbyDQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:06:02 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fda88a-f8ae-4cbc-ab53-dde95843536e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9832b31-1dc7-495c-baa8-cc0437be4427]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 (non-flash)
Aug 09 21:06:02 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30374790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f534438c-c04e-4927-a281-b77f5ab7f521]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5953a9-ecb0-4570-9f42-acb2a319b36e]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0afa73-5520-41db-a63f-ca89ac5f50db]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb5356c-cb19-4822-83c5-ec18f5dc8c99]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71126ef-1c6e-47f6-8a29-dae82ec278f3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b595f-3e95-4185-aa76-835703a0227c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260]
Aug 09 21:06:02 user nova-compute[72620]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8, portal: 172.16.0.220,3260] successful.
Aug 09 21:06:02 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c9286a4-3a81-466c-92ad-dc9e4ba8d0b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9affa-f548-4736-b11d-8d8f194f2336]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== disconnect_volume: return (268ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:06:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:06:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-43c99b02-5343-4bec-8b30-7ecd93ee8578 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.584s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing instance network info cache due to event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] Acquiring lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] Acquired lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updated VIF entry in instance network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG nova.network.neutron [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:06:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e9486dce-163e-4dce-9ff8-4284459cc120 req-e665549c-11c9-40ea-99e1-e2a5aab9afb5 service nova] Releasing lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:06:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:07 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:06:07 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:06:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:06:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=25.31911849975586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 26439232-cff4-4486-81aa-9c614fcbe097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:06:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:06:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:06:18 user nova-compute[72620]: INFO nova.compute.claims [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Claim successful on node user
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:06:18 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:06:18 user nova-compute[72620]: INFO nova.virt.block_device [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Booting with volume fa77a431-506b-401d-9c56-62848a385a81 at /dev/vda
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.utils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfe632-b2e4-43a4-a8a8-13f115bd0767]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.policy [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d65ef4e7f0a4bb0a66040199d6fff2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81cadeef3dc4103a9cb724cb24ea671', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be92ad8-dc97-42e5-9698-c37f8934397e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd6c7ee-c622-4053-8473-5f2591d8154a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d9749-d93a-442f-9240-f5385e46b92a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:06:18 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:06:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9e719e-99db-4807-9bcb-891ff29c7e46]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG os_brick.utils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:06:18 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating existing volume attachment record: 5c368745-38f1-413e-9690-fea8d6b94f6d {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:06:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Successfully created port: 9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Successfully updated port: 9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquired lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.compute.manager [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing instance network info cache due to event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] Acquiring lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:06:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating instance_info_cache with network_info: [{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Releasing lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Instance network_info: |[{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] Acquired lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updated VIF entry in instance network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating instance_info_cache with network_info: [{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:06:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c7455d3b-e82b-45ba-945c-7ee8749ee7a2 req-34d6666e-5b58-4eeb-a9b4-6a5ba0723a8b service nova] Releasing lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:06:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:06:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Creating image(s)
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Ensure instance console log exists: /opt/stack/data/nova/instances/6ee3ab18-3c45-47dd-a2c7-4eba5574676c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Start _get_guest_xml network_info=[{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNbLGYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6ee3ab18-3c45-47dd-a2c7-4eba5574676c', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa77a431-506b-401d-9c56-62848a385a81', 'serial': 'fa77a431-506b-401d-9c56-62848a385a81'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '5c368745-38f1-413e-9690-fea8d6b94f6d', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:06:27 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:27 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNbLGYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:06:27 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:06:27 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:06:27 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cadfb2c-c112-469d-85e0-39ceabc1d344]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:06:27 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741800f-a7bb-4847-8dcd-410ec26e7237]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81] added
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4795fd48-5279-4a46-af8b-74aff016f6ed]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c96beb2-19bd-4077-80b9-9fe351cc228a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNbLGYQD {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNbLGYQD" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae927d86-b5d0-49ab-b3af-c35ef2082389]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNbLGYQD'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[019514dd-fac6-48e9-8992-f915ca7e1996]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db5d65-7c9a-4864-a8c9-5e330ea776f2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ecf056-f687-4968-8004-d5c1f7af9de4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260]
Aug 09 21:06:27 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260] successful.
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ba3214-409f-453d-89e6-7d850a94d23f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e59cf7d-a29d-4c18-b2fc-22ce6bbe9c99]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:06:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ee69c-75f4-483d-aa9c-bde34a61d747]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:06:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNbLGYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23430663764373539', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430663764373539', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2036215266',display_name='tempest-TestVolumeBootPattern-server-2036215266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2036215266',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-vzkld56n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:06:19Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=6ee3ab18-3c45-47dd-a2c7-4eba5574676c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ee3ab18-3c45-47dd-a2c7-4eba5574676c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:06:28 user nova-compute[72620]:   <uuid>6ee3ab18-3c45-47dd-a2c7-4eba5574676c</uuid>
Aug 09 21:06:28 user nova-compute[72620]:   <name>instance-0000002a</name>
Aug 09 21:06:28 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:06:28 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:06:28 user nova-compute[72620]:   <metadata>
Aug 09 21:06:28 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:06:28 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:06:28 user nova-compute[72620]:       <nova:name>tempest-TestVolumeBootPattern-server-2036215266</nova:name>
Aug 09 21:06:28 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:06:27</nova:creationTime>
Aug 09 21:06:28 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:06:28 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:06:28 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:06:28 user nova-compute[72620]:       <nova:owner>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:user uuid="2d65ef4e7f0a4bb0a66040199d6fff2a">tempest-TestVolumeBootPattern-2025401623-project-member</nova:user>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:project uuid="b81cadeef3dc4103a9cb724cb24ea671">tempest-TestVolumeBootPattern-2025401623</nova:project>
Aug 09 21:06:28 user nova-compute[72620]:       </nova:owner>
Aug 09 21:06:28 user nova-compute[72620]:       <nova:ports>
Aug 09 21:06:28 user nova-compute[72620]:         <nova:port uuid="9e008ab8-774e-42da-8557-a69f1d4d842e">
Aug 09 21:06:28 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 09 21:06:28 user nova-compute[72620]:         </nova:port>
Aug 09 21:06:28 user nova-compute[72620]:       </nova:ports>
Aug 09 21:06:28 user nova-compute[72620]:     </nova:instance>
Aug 09 21:06:28 user nova-compute[72620]:   </metadata>
Aug 09 21:06:28 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:06:28 user nova-compute[72620]:     <system>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="serial">6ee3ab18-3c45-47dd-a2c7-4eba5574676c</entry>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="uuid">6ee3ab18-3c45-47dd-a2c7-4eba5574676c</entry>
Aug 09 21:06:28 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:06:28 user nova-compute[72620]:     </system>
Aug 09 21:06:28 user nova-compute[72620]:   </sysinfo>
Aug 09 21:06:28 user nova-compute[72620]:   <os>
Aug 09 21:06:28 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:06:28 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:06:28 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:06:28 user nova-compute[72620]:   </os>
Aug 09 21:06:28 user nova-compute[72620]:   <features>
Aug 09 21:06:28 user nova-compute[72620]:     <acpi/>
Aug 09 21:06:28 user nova-compute[72620]:     <apic/>
Aug 09 21:06:28 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:06:28 user nova-compute[72620]:   </features>
Aug 09 21:06:28 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:06:28 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:06:28 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:06:28 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:06:28 user nova-compute[72620]:   </clock>
Aug 09 21:06:28 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:06:28 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:06:28 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:06:28 user nova-compute[72620]:   </cpu>
Aug 09 21:06:28 user nova-compute[72620]:   <devices>
Aug 09 21:06:28 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:06:28 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:06:28 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 21:06:28 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:06:28 user nova-compute[72620]:       <serial>fa77a431-506b-401d-9c56-62848a385a81</serial>
Aug 09 21:06:28 user nova-compute[72620]:     </disk>
Aug 09 21:06:28 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:06:28 user nova-compute[72620]:       <mac address="fa:16:3e:d2:69:33"/>
Aug 09 21:06:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:06:28 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:06:28 user nova-compute[72620]:       <target dev="tap9e008ab8-77"/>
Aug 09 21:06:28 user nova-compute[72620]:     </interface>
Aug 09 21:06:28 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:06:28 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/6ee3ab18-3c45-47dd-a2c7-4eba5574676c/console.log" append="off"/>
Aug 09 21:06:28 user nova-compute[72620]:     </serial>
Aug 09 21:06:28 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:06:28 user nova-compute[72620]:     <video>
Aug 09 21:06:28 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:06:28 user nova-compute[72620]:     </video>
Aug 09 21:06:28 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:06:28 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:06:28 user nova-compute[72620]:     </rng>
Aug 09 21:06:28 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:06:28 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:06:28 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:06:28 user nova-compute[72620]:     </memballoon>
Aug 09 21:06:28 user nova-compute[72620]:   </devices>
Aug 09 21:06:28 user nova-compute[72620]: </domain>
Aug 09 21:06:28 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2036215266',display_name='tempest-TestVolumeBootPattern-server-2036215266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2036215266',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-vzkld56n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:06:19Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=6ee3ab18-3c45-47dd-a2c7-4eba5574676c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG os_vif [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e008ab8-77, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e008ab8-77, col_values=(('external_ids', {'iface-id': '9e008ab8-774e-42da-8557-a69f1d4d842e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:69:33', 'vm-uuid': '6ee3ab18-3c45-47dd-a2c7-4eba5574676c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:28 user nova-compute[72620]: INFO os_vif [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77')
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:06:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] No VIF found with MAC fa:16:3e:d2:69:33, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:06:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] No waiting events found dispatching network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:06:30 user nova-compute[72620]: WARNING nova.compute.manager [req-f625ba9e-6bd5-4092-a2a9-92748c43ca3c req-b35d9c6f-4d7c-4b3b-b833-5990197bfda4 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received unexpected event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e for instance with vm_state building and task_state spawning.
Aug 09 21:06:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615192.0548458, 6ee3ab18-3c45-47dd-a2c7-4eba5574676c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] VM Resumed (Lifecycle Event)
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Instance spawned successfully.
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615192.057975, 6ee3ab18-3c45-47dd-a2c7-4eba5574676c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] VM Started (Lifecycle Event)
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:32 user nova-compute[72620]: INFO nova.compute.manager [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Took 13.93 seconds to build instance.
Aug 09 21:06:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-0f1ac329-cbab-43c4-9967-e7ba3d60b3bc tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.033s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] No waiting events found dispatching network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:06:32 user nova-compute[72620]: WARNING nova.compute.manager [req-5e641736-feee-44ae-85a7-e2009b63e723 req-9244b6ae-b64c-4089-be03-2fb5fff0bd79 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received unexpected event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e for instance with vm_state active and task_state None.
Aug 09 21:06:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:06:48 user nova-compute[72620]: INFO nova.compute.claims [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Claim successful on node user
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:06:48 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:06:48 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Creating image(s)
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "/opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG nova.policy [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8831d0d8fa4dd08c79611d77c6eae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4606478775694a338c2bc8d46ee3c4d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:48 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk 1073741824" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Successfully created port: 11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Cannot resize image /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'migration_context' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Ensure instance console log exists: /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Successfully updated port: 11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquired lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-changed-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Refreshing instance network info cache due to event network-changed-11e42eee-f460-4d19-9116-f09d4edb1860. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] Acquiring lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Releasing lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Instance network_info: |[{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] Acquired lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Refreshing network info cache for port 11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Start _get_guest_xml network_info=[{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:06:50 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:50 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1344460308',display_name='tempest-AttachVolumeNegativeTest-server-1344460308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1344460308',id=43,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmkyFXouUOSCi8wnjgIXI9fEZ3uSgkG+a2jyCsjXHUPQz5jaawej8vl0nqTgBrfyNua1TSa3VWTLFNhqoLAVQNI7zwRKn69H/ziVd1Ua5R20tI225EAQU9Z944FyO/nSA==',key_name='tempest-keypair-1881507627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-xpo23b2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.objects.instance [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'pci_devices' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:06:50 user nova-compute[72620]:   <uuid>a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0</uuid>
Aug 09 21:06:50 user nova-compute[72620]:   <name>instance-0000002b</name>
Aug 09 21:06:50 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:06:50 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:06:50 user nova-compute[72620]:   <metadata>
Aug 09 21:06:50 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:06:50 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1344460308</nova:name>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:06:50</nova:creationTime>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:06:50 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:06:50 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:owner>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:user uuid="0e8831d0d8fa4dd08c79611d77c6eae8">tempest-AttachVolumeNegativeTest-1201906540-project-member</nova:user>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:project uuid="4606478775694a338c2bc8d46ee3c4d7">tempest-AttachVolumeNegativeTest-1201906540</nova:project>
Aug 09 21:06:50 user nova-compute[72620]:       </nova:owner>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:06:50 user nova-compute[72620]:       <nova:ports>
Aug 09 21:06:50 user nova-compute[72620]:         <nova:port uuid="11e42eee-f460-4d19-9116-f09d4edb1860">
Aug 09 21:06:50 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 21:06:50 user nova-compute[72620]:         </nova:port>
Aug 09 21:06:50 user nova-compute[72620]:       </nova:ports>
Aug 09 21:06:50 user nova-compute[72620]:     </nova:instance>
Aug 09 21:06:50 user nova-compute[72620]:   </metadata>
Aug 09 21:06:50 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:06:50 user nova-compute[72620]:     <system>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="serial">a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0</entry>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="uuid">a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0</entry>
Aug 09 21:06:50 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:06:50 user nova-compute[72620]:     </system>
Aug 09 21:06:50 user nova-compute[72620]:   </sysinfo>
Aug 09 21:06:50 user nova-compute[72620]:   <os>
Aug 09 21:06:50 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:06:50 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:06:50 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:06:50 user nova-compute[72620]:   </os>
Aug 09 21:06:50 user nova-compute[72620]:   <features>
Aug 09 21:06:50 user nova-compute[72620]:     <acpi/>
Aug 09 21:06:50 user nova-compute[72620]:     <apic/>
Aug 09 21:06:50 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:06:50 user nova-compute[72620]:   </features>
Aug 09 21:06:50 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:06:50 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:06:50 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:06:50 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:06:50 user nova-compute[72620]:   </clock>
Aug 09 21:06:50 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:06:50 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:06:50 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:06:50 user nova-compute[72620]:   </cpu>
Aug 09 21:06:50 user nova-compute[72620]:   <devices>
Aug 09 21:06:50 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:06:50 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:06:50 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk"/>
Aug 09 21:06:50 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:06:50 user nova-compute[72620]:     </disk>
Aug 09 21:06:50 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:06:50 user nova-compute[72620]:       <mac address="fa:16:3e:54:92:53"/>
Aug 09 21:06:50 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:06:50 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:06:50 user nova-compute[72620]:       <target dev="tap11e42eee-f4"/>
Aug 09 21:06:50 user nova-compute[72620]:     </interface>
Aug 09 21:06:50 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:06:50 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/console.log" append="off"/>
Aug 09 21:06:50 user nova-compute[72620]:     </serial>
Aug 09 21:06:50 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:06:50 user nova-compute[72620]:     <video>
Aug 09 21:06:50 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:06:50 user nova-compute[72620]:     </video>
Aug 09 21:06:50 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:06:50 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:06:50 user nova-compute[72620]:     </rng>
Aug 09 21:06:50 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:06:50 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:06:50 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:06:50 user nova-compute[72620]:     </memballoon>
Aug 09 21:06:50 user nova-compute[72620]:   </devices>
Aug 09 21:06:50 user nova-compute[72620]: </domain>
Aug 09 21:06:50 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1344460308',display_name='tempest-AttachVolumeNegativeTest-server-1344460308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1344460308',id=43,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmkyFXouUOSCi8wnjgIXI9fEZ3uSgkG+a2jyCsjXHUPQz5jaawej8vl0nqTgBrfyNua1TSa3VWTLFNhqoLAVQNI7zwRKn69H/ziVd1Ua5R20tI225EAQU9Z944FyO/nSA==',key_name='tempest-keypair-1881507627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-xpo23b2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:06:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG os_vif [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11e42eee-f4, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11e42eee-f4, col_values=(('external_ids', {'iface-id': '11e42eee-f460-4d19-9116-f09d4edb1860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:92:53', 'vm-uuid': 'a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:50 user nova-compute[72620]: INFO os_vif [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4')
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:54:92:53, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updated VIF entry in instance network info cache for port 11e42eee-f460-4d19-9116-f09d4edb1860. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG nova.network.neutron [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:06:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-37877f91-f18c-4807-a613-e6f275f11365 req-8f43ee4e-b5c8-4bbc-9e3e-d647e860e671 service nova] Releasing lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:06:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:06:52 user nova-compute[72620]: WARNING nova.compute.manager [req-824f6726-8e8a-403c-b05a-9c3607ed6dac req-e4d1e69b-4b1a-4d42-8f89-8a6012357d1b service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state building and task_state spawning.
Aug 09 21:06:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615214.0201802, a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] VM Resumed (Lifecycle Event)
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Instance spawned successfully.
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615214.0213008, a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] VM Started (Lifecycle Event)
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:06:54 user nova-compute[72620]: INFO nova.compute.manager [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Took 5.98 seconds to build instance.
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:06:54 user nova-compute[72620]: WARNING nova.compute.manager [req-1faf7ff0-75b1-4a23-92be-ced1602b82ab req-542d3fab-cda6-4043-9f51-c689e0dfb45f service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state active and task_state None.
Aug 09 21:06:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-6a1827a0-e07b-4d0c-a9b6-3c640ceb12f0 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.083s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG nova.objects.instance [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:06:55 user nova-compute[72620]: INFO nova.compute.manager [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attaching volume eb0d74a6-705f-42d5-a2bd-4066b7985325 to /dev/vdb
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.utils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[95798efc-22b0-40cc-aea4-442bdb969937]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e612c-1033-42be-b79f-32f6df040c45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[662379c5-c675-47ba-a2b3-c66e7c25cd36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbaeb98-00b6-4aca-85a8-d60f21be218d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:06:55 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:06:55 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da6d07-24ca-484f-97ac-25d66535525f]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG os_brick.utils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:06:55 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating existing volume attachment record: ac409644-8e33-47ea-8603-a0f7afbd26c8 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:06:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing instance network info cache due to event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:00 user nova-compute[72620]: DEBUG nova.network.neutron [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updated VIF entry in instance network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c3f6bb31-3dc5-42c4-b530-227553aadf06 req-d55af6b2-2cdf-43ce-a005-2d2a98f42d0d service nova] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:01 user nova-compute[72620]: INFO nova.compute.manager [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Shelve offloading
Aug 09 21:07:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance destroyed successfully.
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:02 user nova-compute[72620]: WARNING nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state active and task_state shelving.
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:02 user nova-compute[72620]: WARNING nova.compute.manager [req-5b92c1bc-83e7-4b39-903a-eae0a3cf8938 req-d2ec92cf-f94c-4509-a3d2-34541a992c09 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state active and task_state shelving.
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance destroyed successfully.
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'resources' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3HvjLT8m8blvWfC2jHWiOs5voJLbdry4tOgEM857ySi4jGg+2TpSgeUMb8MBXrKIpjSmVxBY7p76+GLrOsAaSg0x31EBn17X3RdRsOMn66L6vIFATbM9jky1qtLd/Gng==',key_name='tempest-TestShelveInstance-1479066823',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:05:23Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_vif [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66740ed3-6c, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing instance network info cache due to event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:07:03 user nova-compute[72620]: INFO os_vif [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c')
Aug 09 21:07:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:07:03 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dba72a-36c4-4345-92ac-1485cb11e0f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce74c869-d275-494c-89d9-d658423306e8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30561090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70fdb16-8754-4b4b-b2f2-2e7966f71a3a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a1e9e-d705-48b1-a80d-985650790653]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[93477b57-2ed3-4d31-98fd-5afa973314c4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35398b-e408-432c-9ebf-3bc20c3cf2fd]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:07:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f0875b-8705-4816-abc4-c60676902103]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7534b9-e51d-4d1f-89c9-af08be2d1b15]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]
Aug 09 21:07:04 user nova-compute[72620]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.
Aug 09 21:07:04 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01372237-b64c-41d0-bf17-88be116ddc3e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== disconnect_volume: return (339ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:07:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deleting instance files /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c_del
Aug 09 21:07:04 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deletion of /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c_del complete
Aug 09 21:07:04 user nova-compute[72620]: DEBUG nova.network.neutron [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updated VIF entry in instance network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG nova.network.neutron [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": null, "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap66740ed3-6c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-78681aee-1bed-494b-ac94-e263faca8549 req-5d84c616-d8e9-4dc7-bc42-a509eb47b3c9 service nova] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:05 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Deleted allocations for instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG nova.objects.instance [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntOFdVvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:07:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:07:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:07:05 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13351d8-cfee-4b34-b56e-428a0f6734a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:07:05 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726f4d6-1958-4507-a0c4-649b5a18b638]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325] added
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-76b43076-9b98-44db-ad6b-06a70f61516c tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.267s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2fa576-7561-4f43-8bd2-6998f27936d2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be439f-fbae-4dd7-9cd5-3ace723d2d80]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ntOFdVvb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ntOFdVvb" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e65d32-df93-43d7-b579-b9233dc154cc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ntOFdVvb'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b1399-c657-4828-92e1-2c9c4ad8f127]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4665fb6f-53d6-4de5-a53f-00cdc8501664]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b47e1c7-c9fb-4052-9001-f659587eef45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260]
Aug 09 21:07:05 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260] successful.
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d64d28-75c5-4fec-a20e-fb6d01202a90]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab0034-b593-48df-8e8d-bb656c709795]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)
Aug 09 21:07:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b996492c-0cfc-4c7a-b3d2-47774bea34c5]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:07:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntOFdVvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:07:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:07:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23138356434366432', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:07:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138356434366432', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:07:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:07:06 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:07:06 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:07:06 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:07:06 user nova-compute[72620]:   <serial>eb0d74a6-705f-42d5-a2bd-4066b7985325</serial>
Aug 09 21:07:06 user nova-compute[72620]: </disk>
Aug 09 21:07:06 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:07:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:07:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:07:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No VIF found with MAC fa:16:3e:81:de:e3, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:07:07 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-46a0db5e-3666-4cab-86ce-e5bf0098a2e5 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.631s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:07:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid af00c508-a61d-4552-b6f6-3986a7ace32f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:09 user nova-compute[72620]: INFO nova.compute.manager [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Detaching volume eb0d74a6-705f-42d5-a2bd-4066b7985325
Aug 09 21:07:09 user nova-compute[72620]: INFO nova.virt.block_device [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attempting to driver detach volume eb0d74a6-705f-42d5-a2bd-4066b7985325 from mountpoint /dev/vdb
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Attempting to detach device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:07:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:07:09 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:07:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:07:09 user nova-compute[72620]:   <serial>eb0d74a6-705f-42d5-a2bd-4066b7985325</serial>
Aug 09 21:07:09 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:07:09 user nova-compute[72620]: </disk>
Aug 09 21:07:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:07:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config.
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:07:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:07:09 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:07:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:07:09 user nova-compute[72620]:   <serial>eb0d74a6-705f-42d5-a2bd-4066b7985325</serial>
Aug 09 21:07:09 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:07:09 user nova-compute[72620]: </disk>
Aug 09 21:07:09 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updating instance_info_cache with network_info: [{"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-af00c508-a61d-4552-b6f6-3986a7ace32f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615229.8974025, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:07:09 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config.
Aug 09 21:07:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ntOFdVvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:07:09 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ad6200-cc07-46b8-9ad7-65f3598ba8aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf5f5cd-cbc2-49a4-9f58-98cd3ae4a4ac]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 (non-flash)
Aug 09 21:07:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c500fe050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[12477c5d-5417-4a55-9033-6b3f05cc95bc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78dc93d-72ab-44c3-bfd5-da1438779815]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a2cd86-7c3d-4366-887d-2e9e330c73af]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da72a479-e70f-4aa7-8dcf-378734efc90a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8beb33ec-6e54-429d-b828-6a7fba94a1e1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d751ed-3ecd-413a-ac71-2d437a12aec1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260]
Aug 09 21:07:10 user nova-compute[72620]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325, portal: 172.16.0.220,3260] successful.
Aug 09 21:07:10 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb0d74a6-705f-42d5-a2bd-4066b7985325 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a343b7-7615-4503-b404-7e0d2beabb76]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== disconnect_volume: return (282ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-adcafc9e-cd3a-40a0-abde-35f9b58d6e09 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:07:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:07:15 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=7850MB free_disk=25.288318634033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 26439232-cff4-4486-81aa-9c614fcbe097 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6ee3ab18-3c45-47dd-a2c7-4eba5574676c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:07:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:17 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615222.0845158, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:07:17 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Stopped (Lifecycle Event)
Aug 09 21:07:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-58385d7e-098a-4113-894a-874bf4f8dc37 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:07:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG nova.compute.manager [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing instance network info cache due to event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updated VIF entry in instance network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG nova.network.neutron [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-30befd5e-563f-4d64-94cb-30cb081814ef req-37d651ba-99ab-4a50-860f-7199cee86818 service nova] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:07:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:07:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:25 user nova-compute[72620]: INFO nova.compute.manager [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Shelving
Aug 09 21:07:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:25 user nova-compute[72620]: WARNING nova.compute.manager [req-f01733ac-493b-4283-9701-c48f28694ece req-823212de-fe53-4d77-ae8c-611326a6526d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving.
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance destroyed successfully.
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Beginning cold snapshot process
Aug 09 21:07:26 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 21:07:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk /opt/stack/data/nova/instances/snapshots/tmp7840ldmq/94fb1c882a894b98be4268ccec452ff0 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:07:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk /opt/stack/data/nova/instances/snapshots/tmp7840ldmq/94fb1c882a894b98be4268ccec452ff0" returned: 0 in 0.977s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:07:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Snapshot extracted, beginning image upload
Aug 09 21:07:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:28 user nova-compute[72620]: WARNING nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:28 user nova-compute[72620]: WARNING nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:28 user nova-compute[72620]: WARNING nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:28 user nova-compute[72620]: WARNING nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:07:28 user nova-compute[72620]: WARNING nova.compute.manager [req-675aacd0-2f19-4524-97c6-b17efdaf3224 req-38028198-a785-4e80-8007-8ca48c83cd6d service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:07:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Snapshot image upload complete
Aug 09 21:07:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:07:29 user nova-compute[72620]: INFO nova.compute.manager [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Shelve offloading
Aug 09 21:07:29 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance destroyed successfully.
Aug 09 21:07:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:07:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:07:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance destroyed successfully.
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'resources' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTS+9HyWtzG8zzYFJ5yEiELG8nmunC2LTFfSkxG7p5Ymt0M6e8zP/9RQ+OdEvUTnG0bRvEEPNpuptha4KyQq4rJ0CXRdiCxBIwOyOftihc1G7lNara27YCa5tes9I0lbQ==',key_name='tempest-keypair-629849260',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:07:29.894996',shelved_host='user',shelved_image_id='53feb156-c2d6-4fea-9425-79b17783f60b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG os_vif [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae913f60-00, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:07:31 user nova-compute[72620]: INFO os_vif [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00')
Aug 09 21:07:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Deleting instance files /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4_del
Aug 09 21:07:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Deletion of /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4_del complete
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing instance network info cache due to event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:07:31 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Deleted allocations for instance 6070294c-4df8-45cc-8d89-128df66bf0d4
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'numa_topology' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-182bf64d-3822-433b-a23c-3422bff964c2 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.205s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updated VIF entry in instance network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapae913f60-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:07:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2e79bbce-51f6-41ad-bfe6-7adf81aa98f4 req-364bc97d-b0f4-4e5a-b037-b94cfe45fde6 service nova] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:07:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:07:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:41 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615246.3726718, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:07:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Stopped (Lifecycle Event)
Aug 09 21:07:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-738a18ae-f4d8-4a96-b17b-f0f4d171dbb5 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:07:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:07:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:07:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:03 user nova-compute[72620]: INFO nova.compute.manager [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attaching volume 2d624567-4f76-47f6-a09b-f911e32aa563 to /dev/vdb
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.utils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d79c24e-8eaa-4cd7-bc54-010c40c3b6e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e430c-5574-494f-9566-c07a3a36689c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da67c440-52ef-4ef1-93ac-fb36dd69fa34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35294ec-97cc-4661-95d9-8f019ba69611]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:03 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:08:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a0f39e-3e34-40e6-a0f8-c4f07f93d99b]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG os_brick.utils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:03 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating existing volume attachment record: 092901f0-cdb0-4882-a7be-6ba7b9d5a995 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:08:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:08 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:08:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:08 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:08:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:09 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [{"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-54aab7a9-83eb-43bc-ae55-8b3833abada3" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:08:09 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG nova.compute.manager [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing instance network info cache due to event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] Acquiring lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] Acquired lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG nova.network.neutron [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:08:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updated VIF entry in instance network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating instance_info_cache with network_info: [{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d349ee02-f66e-4d11-bd86-63e3501c910c req-cd5d128d-cc27-4037-8afa-2222b7f4c8a7 service nova] Releasing lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing instance network info cache due to event network-changed-9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] Acquiring lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] Acquired lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Refreshing network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:11 user nova-compute[72620]: INFO nova.compute.manager [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Terminating instance
Aug 09 21:08:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXdlPBYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:12 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:12 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:12 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updated VIF entry in instance network info cache for port 9e008ab8-774e-42da-8557-a69f1d4d842e. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating instance_info_cache with network_info: [{"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3e4504db-1a22-4bb3-8cbc-6ac32ee231e4 req-0ade669c-7ac2-4203-9663-68d67133c2dc service nova] Releasing lock "refresh_cache-6ee3ab18-3c45-47dd-a2c7-4eba5574676c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac5861-ab80-4767-a5e7-a1b740beea55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:08:12 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089b6de-67e0-44d3-9fa9-89619dfe6b15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563] added
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Instance destroyed successfully.
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.objects.instance [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid 6ee3ab18-3c45-47dd-a2c7-4eba5574676c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2036215266',display_name='tempest-TestVolumeBootPattern-server-2036215266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2036215266',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-vzkld56n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:06:32Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=6ee3ab18-3c45-47dd-a2c7-4eba5574676c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "9e008ab8-774e-42da-8557-a69f1d4d842e", "address": "fa:16:3e:d2:69:33", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008ab8-77", "ovs_interfaceid": "9e008ab8-774e-42da-8557-a69f1d4d842e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_vif [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc5e51-80e2-4626-91b9-803f73c637ac]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e008ab8-77, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:12 user nova-compute[72620]: INFO os_vif [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:69:33,bridge_name='br-int',has_traffic_filtering=True,id=9e008ab8-774e-42da-8557-a69f1d4d842e,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008ab8-77')
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNbLGYQD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:12 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c43b30-cbd5-4af8-b925-cd978fae453b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXdlPBYa {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-unplugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] No waiting events found dispatching network-vif-unplugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-unplugged-9e008ab8-774e-42da-8557-a69f1d4d842e for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Acquiring lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] No waiting events found dispatching network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:08:12 user nova-compute[72620]: WARNING nova.compute.manager [req-7d031a89-1e10-47b2-8c74-c236fd4a0c31 req-dc4bf3a8-05e1-4bb1-a041-a660aef843bf service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received unexpected event network-vif-plugged-9e008ab8-774e-42da-8557-a69f1d4d842e for instance with vm_state active and task_state deleting.
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hXdlPBYa" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f605c86b-fc97-4fa5-8a91-45cc785db979]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hXdlPBYa'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc1bef-ef61-46a8-bf1a-016a9881ef0a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3f3fa0-78dc-42b6-ab6e-3933585000f7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4620b3c-a99b-47f9-bacd-de58fd7f7281]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260]
Aug 09 21:08:12 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260] successful.
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce58ea9-6f00-4ed6-90c6-07c6baf12473]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[41512ca1-4ee0-4196-9345-dba3ab26c726]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24acfca-9530-49bf-8523-6f6dd9f440ea]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXdlPBYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23031613432653966', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031613432653966', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.225s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ac6ed9-ca02-4455-aea6-ee2fd66f2586]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:08:13 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:08:13 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:08:13 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:08:13 user nova-compute[72620]:   <serial>2d624567-4f76-47f6-a09b-f911e32aa563</serial>
Aug 09 21:08:13 user nova-compute[72620]: </disk>
Aug 09 21:08:13 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f790f-a6a9-42d4-9abd-249deffb0607]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:13 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305632e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8f50d-efe7-40e6-be96-c35ee46211e2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac98515e-4602-4b52-ac53-8b6c0fdb404c]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[831445e9-aae5-4c4c-a79c-41a4defcae62]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[94022ae3-79bc-4bc4-85c8-9d1b2372a1dc]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f8e3f5-cb90-4dc6-a163-2b83b66d8d59]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b375f92-1e42-4e4d-93af-a623740fb41c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260]
Aug 09 21:08:13 user nova-compute[72620]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81, portal: 172.16.0.220,3260] successful.
Aug 09 21:08:13 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:13 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa77a431-506b-401d-9c56-62848a385a81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba265514-1afb-4a10-9190-e90237235245]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (1547ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:08:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Deleting instance files /opt/stack/data/nova/instances/6ee3ab18-3c45-47dd-a2c7-4eba5574676c_del
Aug 09 21:08:14 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Deletion of /opt/stack/data/nova/instances/6ee3ab18-3c45-47dd-a2c7-4eba5574676c_del complete
Aug 09 21:08:14 user nova-compute[72620]: INFO nova.compute.manager [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Took 2.43 seconds to destroy the instance on the hypervisor.
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No VIF found with MAC fa:16:3e:81:de:e3, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-93b9ff75-9493-4cab-9b97-6cf824c8c3ac tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.656s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:14 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Took 0.52 seconds to deallocate network for instance.
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.compute.manager [req-7bc56d2b-22af-4517-8d21-88133dd67295 req-9458d1ab-3e27-4fd5-8405-d5cf0a9eaf4a service nova] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Received event network-vif-deleted-9e008ab8-774e-42da-8557-a69f1d4d842e {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:08:14 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: INFO nova.compute.manager [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Took 0.74 seconds to detach 1 volumes for instance.
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:08:16 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:08:16 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8178MB free_disk=25.248512268066406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.916s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.044s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:16 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance 6ee3ab18-3c45-47dd-a2c7-4eba5574676c
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance af00c508-a61d-4552-b6f6-3986a7ace32f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 26439232-cff4-4486-81aa-9c614fcbe097 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-585460d0-f6f3-4b27-ad8a-ffc384c58fef tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "6ee3ab18-3c45-47dd-a2c7-4eba5574676c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.808s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:16 user nova-compute[72620]: INFO nova.compute.manager [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Detaching volume 2d624567-4f76-47f6-a09b-f911e32aa563
Aug 09 21:08:17 user nova-compute[72620]: INFO nova.virt.block_device [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attempting to driver detach volume 2d624567-4f76-47f6-a09b-f911e32aa563 from mountpoint /dev/vdb
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Attempting to detach device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:08:17 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:08:17 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:08:17 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:08:17 user nova-compute[72620]:   <serial>2d624567-4f76-47f6-a09b-f911e32aa563</serial>
Aug 09 21:08:17 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:08:17 user nova-compute[72620]: </disk>
Aug 09 21:08:17 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:08:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config.
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:08:17 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:08:17 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:08:17 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:08:17 user nova-compute[72620]:   <serial>2d624567-4f76-47f6-a09b-f911e32aa563</serial>
Aug 09 21:08:17 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:08:17 user nova-compute[72620]: </disk>
Aug 09 21:08:17 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615297.5024984, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:08:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config.
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hXdlPBYa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:17 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4f40b8-a41a-4108-8e32-0c943ac80b14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af516d6-8988-43ec-a30e-c1653f2062f7]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:17 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:17 user nova-compute[72620]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 (non-flash)
Aug 09 21:08:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c61de2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c936234-f59d-421c-b345-835e18726dc8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9536f9-8edc-45a6-b582-2b5c8e81c891]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4165d665-bdee-4eed-9725-b03b0e8b64da]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4316faf-b207-4bd3-9767-fafca7655b7c]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1599ccd7-41bd-4190-8331-2166077c486b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb5df0-c995-4cf1-98d4-e2c0661f5c47]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260]
Aug 09 21:08:17 user nova-compute[72620]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563, portal: 172.16.0.220,3260] successful.
Aug 09 21:08:17 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d624567-4f76-47f6-a09b-f911e32aa563 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c2644-27ba-4707-b8fa-a9720bda32ba]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== disconnect_volume: return (287ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:08:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:18 user nova-compute[72620]: DEBUG nova.objects.instance [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-5e62ee58-7e02-4a44-afb3-9dade49d9466 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid af00c508-a61d-4552-b6f6-3986a7ace32f {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 26439232-cff4-4486-81aa-9c614fcbe097 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "26439232-cff4-4486-81aa-9c614fcbe097" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "26439232-cff4-4486-81aa-9c614fcbe097" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:27 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615292.4280775, 6ee3ab18-3c45-47dd-a2c7-4eba5574676c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:08:27 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] VM Stopped (Lifecycle Event)
Aug 09 21:08:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6ce5e7b8-63a2-41f8-9aa7-592551391e09 None None] [instance: 6ee3ab18-3c45-47dd-a2c7-4eba5574676c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:08:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:30 user nova-compute[72620]: INFO nova.compute.manager [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Terminating instance
Aug 09 21:08:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-unplugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] No waiting events found dispatching network-vif-unplugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-4a96dd13-a464-4223-a0e3-8241caad9697 req-e73ec243-b6d4-405f-aa47-0a2fc968eec8 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-unplugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Instance destroyed successfully.
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lazy-loading 'resources' on Instance uuid af00c508-a61d-4552-b6f6-3986a7ace32f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T20:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1579621216',display_name='tempest-ServersNegativeTestJSON-server-1579621216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1579621216',id=34,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T20:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bd2c07ea7f842229e5314dafe75ff83',ramdisk_id='',reservation_id='r-bab7s4b6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-905468876',owner_user_name='tempest-ServersNegativeTestJSON-905468876-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T20:59:45Z,user_data=None,user_id='111c4dccd3bb4dbab05dc591ca40d7bc',uuid=af00c508-a61d-4552-b6f6-3986a7ace32f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converting VIF {"id": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "address": "fa:16:3e:c1:59:da", "network": {"id": "42c02acf-2968-4b16-8578-256b38114e55", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2046720836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bd2c07ea7f842229e5314dafe75ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6440dc2d-c5", "ovs_interfaceid": "6440dc2d-c50d-48b7-826f-8cf81a86a0a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG os_vif [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6440dc2d-c5, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:31 user nova-compute[72620]: INFO os_vif [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:59:da,bridge_name='br-int',has_traffic_filtering=True,id=6440dc2d-c50d-48b7-826f-8cf81a86a0a4,network=Network(42c02acf-2968-4b16-8578-256b38114e55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6440dc2d-c5')
Aug 09 21:08:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Deleting instance files /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f_del
Aug 09 21:08:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Deletion of /opt/stack/data/nova/instances/af00c508-a61d-4552-b6f6-3986a7ace32f_del complete
Aug 09 21:08:31 user nova-compute[72620]: INFO nova.compute.manager [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 21:08:31 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:08:31 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Took 0.50 seconds to deallocate network for instance.
Aug 09 21:08:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-2cca820c-bf22-4917-b729-4b0d8ad0fcad req-90ee7c46-0c96-4277-a5c4-56d178c8cc89 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-deleted-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:08:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:32 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Deleted allocations for instance af00c508-a61d-4552-b6f6-3986a7ace32f
Aug 09 21:08:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33259e01-5bd2-418b-93b5-c08b444d6a8e tempest-ServersNegativeTestJSON-905468876 tempest-ServersNegativeTestJSON-905468876-project-member] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] Acquiring lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] Lock "af00c508-a61d-4552-b6f6-3986a7ace32f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] No waiting events found dispatching network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:08:33 user nova-compute[72620]: WARNING nova.compute.manager [req-e3b68e32-9a52-4c68-9352-89fed1172c35 req-c49a092f-9399-478a-8c2c-a516f6b89a94 service nova] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Received unexpected event network-vif-plugged-6440dc2d-c50d-48b7-826f-8cf81a86a0a4 for instance with vm_state deleted and task_state None.
Aug 09 21:08:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-changed-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Refreshing instance network info cache due to event network-changed-11e42eee-f460-4d19-9116-f09d4edb1860. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:08:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] Acquiring lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] Acquired lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:38 user nova-compute[72620]: DEBUG nova.network.neutron [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Refreshing network info cache for port 11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:08:39 user nova-compute[72620]: DEBUG nova.network.neutron [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updated VIF entry in instance network info cache for port 11e42eee-f460-4d19-9116-f09d4edb1860. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:08:39 user nova-compute[72620]: DEBUG nova.network.neutron [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6714f6fc-7475-44be-8060-0e168fb4cae7 req-08de5cef-cb69-4073-8df2-2bba685daef0 service nova] Releasing lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:08:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:43 user nova-compute[72620]: INFO nova.compute.manager [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Attaching volume 55e469be-2fb6-4467-bf1a-9a5681e6cee1 to /dev/vdb
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.utils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eacf577-f901-4b21-a23f-611a26fc9fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5890004-3f99-4dde-8e3b-1867cc9b6bf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[319f5c98-c803-4995-8d3f-46662bed6100]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb58e53-6795-46f4-a241-06ff325b5b29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:43 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:08:43 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5ccf1c-708e-4056-bb66-a6056f178cc6]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG os_brick.utils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:43 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating existing volume attachment record: 8149e0f7-0307-49a1-9c91-04ccfcc14239 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:08:46 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615311.6793275, af00c508-a61d-4552-b6f6-3986a7ace32f => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:08:46 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] VM Stopped (Lifecycle Event)
Aug 09 21:08:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-90e00d58-61bb-4864-9f94-25d2372244ca None None] [instance: af00c508-a61d-4552-b6f6-3986a7ace32f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:08:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsnQGXkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:51 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:51 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:08:51 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55aea28-730d-44c3-ae0d-93a27713eb6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:08:51 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fd399-e1d5-43b8-b278-121c4680f050]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1] added
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f5ea1-b207-4093-a8ff-462f4a572dd6]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[073bafb5-4e36-4cf0-83e8-f9f3eb435944]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gsnQGXkd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gsnQGXkd" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[852a3f8d-485a-4bd9-9f47-fbf1fabb4fd4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gsnQGXkd'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc86611-9c48-4056-911e-ad7a887dd07f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[51038365-0668-494b-ac1f-e21928a3878a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[19415f9e-19f3-4b58-840b-90b01a278406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260]
Aug 09 21:08:51 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260] successful.
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbcdc66-c8be-45e1-b7bb-2a9f14fbc5f2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19dd765-f051-4fbb-88e4-29719c8f7e91]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:08:51 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a97078-4d97-4c6e-8826-61f68934e020]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:08:51 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsnQGXkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:08:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:08:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23064316462333230', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064316462333230', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:08:52 user nova-compute[72620]: DEBUG nova.objects.instance [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:08:52 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:08:52 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:08:52 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:08:52 user nova-compute[72620]:   <serial>55e469be-2fb6-4467-bf1a-9a5681e6cee1</serial>
Aug 09 21:08:52 user nova-compute[72620]: </disk>
Aug 09 21:08:52 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:53 user nova-compute[72620]: INFO nova.compute.manager [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Unshelving
Aug 09 21:08:53 user nova-compute[72620]: INFO nova.virt.block_device [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Booting with volume 980f76d7-d3be-4399-b616-c4e3351d8f79 at /dev/vda
Aug 09 21:08:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:54:92:53, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.utils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13f25d-3233-46dd-8588-33019338c53b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6f242-74ec-4e36-ba3b-c2479b808336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5610f89-f91a-4129-9793-896202af27a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ebb879-097d-4a3c-93c8-81dca5585ba5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-92950577-a1f8-4654-bcc5-24fc769c4fdd tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.281s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:08:53 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:08:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cafaec4-7d3c-46cd-94a4-28aec47f866c]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG os_brick.utils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:08:53 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating existing volume attachment record: b3f04b31-836f-4065-b6e9-2c7e1e4b35df {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:08:56 user nova-compute[72620]: INFO nova.compute.claims [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Claim successful on node user
Aug 09 21:08:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:56 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:08:57 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.policy [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8831d0d8fa4dd08c79611d77c6eae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4606478775694a338c2bc8d46ee3c4d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:08:57 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Creating image(s)
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "/opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk 1073741824" returned: 0 in 0.048s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Cannot resize image /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'migration_context' on Instance uuid 21aec6af-f651-4a8c-9546-7a7180cd69ad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Ensure instance console log exists: /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:08:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Successfully created port: 69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:08:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Successfully updated port: 69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:08:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquired lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-changed-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Refreshing instance network info cache due to event network-changed-69e3c49c-41a9-4c43-9847-7ed25fd6b52f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] Acquiring lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updating instance_info_cache with network_info: [{"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Releasing lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Instance network_info: |[{"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] Acquired lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Refreshing network info cache for port 69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Start _get_guest_xml network_info=[{"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:08:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:08:59 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521890085',display_name='tempest-AttachVolumeNegativeTest-server-521890085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521890085',id=44,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMoQJr2tWYeIwA4XpkigdIFn912+J1zOnrfwHo42ZfLSgNGkfwgXKDM7BrynpopO2444NSr1OJ77RXG3d+KRie2cJUDVKWv5kQ5eAXlYnpQxIn1Yx/aGWTWweMAZN4Kw==',key_name='tempest-keypair-1627832457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-w89jx77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=21aec6af-f651-4a8c-9546-7a7180cd69ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'pci_devices' on Instance uuid 21aec6af-f651-4a8c-9546-7a7180cd69ad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:08:59 user nova-compute[72620]:   <uuid>21aec6af-f651-4a8c-9546-7a7180cd69ad</uuid>
Aug 09 21:08:59 user nova-compute[72620]:   <name>instance-0000002c</name>
Aug 09 21:08:59 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:08:59 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:08:59 user nova-compute[72620]:   <metadata>
Aug 09 21:08:59 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:08:59 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeNegativeTest-server-521890085</nova:name>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:08:59</nova:creationTime>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:08:59 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:08:59 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:owner>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:user uuid="0e8831d0d8fa4dd08c79611d77c6eae8">tempest-AttachVolumeNegativeTest-1201906540-project-member</nova:user>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:project uuid="4606478775694a338c2bc8d46ee3c4d7">tempest-AttachVolumeNegativeTest-1201906540</nova:project>
Aug 09 21:08:59 user nova-compute[72620]:       </nova:owner>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:08:59 user nova-compute[72620]:       <nova:ports>
Aug 09 21:08:59 user nova-compute[72620]:         <nova:port uuid="69e3c49c-41a9-4c43-9847-7ed25fd6b52f">
Aug 09 21:08:59 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 09 21:08:59 user nova-compute[72620]:         </nova:port>
Aug 09 21:08:59 user nova-compute[72620]:       </nova:ports>
Aug 09 21:08:59 user nova-compute[72620]:     </nova:instance>
Aug 09 21:08:59 user nova-compute[72620]:   </metadata>
Aug 09 21:08:59 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:08:59 user nova-compute[72620]:     <system>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="serial">21aec6af-f651-4a8c-9546-7a7180cd69ad</entry>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="uuid">21aec6af-f651-4a8c-9546-7a7180cd69ad</entry>
Aug 09 21:08:59 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:08:59 user nova-compute[72620]:     </system>
Aug 09 21:08:59 user nova-compute[72620]:   </sysinfo>
Aug 09 21:08:59 user nova-compute[72620]:   <os>
Aug 09 21:08:59 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:08:59 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:08:59 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:08:59 user nova-compute[72620]:   </os>
Aug 09 21:08:59 user nova-compute[72620]:   <features>
Aug 09 21:08:59 user nova-compute[72620]:     <acpi/>
Aug 09 21:08:59 user nova-compute[72620]:     <apic/>
Aug 09 21:08:59 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:08:59 user nova-compute[72620]:   </features>
Aug 09 21:08:59 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:08:59 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:08:59 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:08:59 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:08:59 user nova-compute[72620]:   </clock>
Aug 09 21:08:59 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:08:59 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:08:59 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:08:59 user nova-compute[72620]:   </cpu>
Aug 09 21:08:59 user nova-compute[72620]:   <devices>
Aug 09 21:08:59 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:08:59 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:08:59 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk"/>
Aug 09 21:08:59 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:08:59 user nova-compute[72620]:     </disk>
Aug 09 21:08:59 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:08:59 user nova-compute[72620]:       <mac address="fa:16:3e:b5:94:25"/>
Aug 09 21:08:59 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:08:59 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:08:59 user nova-compute[72620]:       <target dev="tap69e3c49c-41"/>
Aug 09 21:08:59 user nova-compute[72620]:     </interface>
Aug 09 21:08:59 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:08:59 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/console.log" append="off"/>
Aug 09 21:08:59 user nova-compute[72620]:     </serial>
Aug 09 21:08:59 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:08:59 user nova-compute[72620]:     <video>
Aug 09 21:08:59 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:08:59 user nova-compute[72620]:     </video>
Aug 09 21:08:59 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:08:59 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:08:59 user nova-compute[72620]:     </rng>
Aug 09 21:08:59 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:08:59 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:08:59 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:08:59 user nova-compute[72620]:     </memballoon>
Aug 09 21:08:59 user nova-compute[72620]:   </devices>
Aug 09 21:08:59 user nova-compute[72620]: </domain>
Aug 09 21:08:59 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521890085',display_name='tempest-AttachVolumeNegativeTest-server-521890085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521890085',id=44,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMoQJr2tWYeIwA4XpkigdIFn912+J1zOnrfwHo42ZfLSgNGkfwgXKDM7BrynpopO2444NSr1OJ77RXG3d+KRie2cJUDVKWv5kQ5eAXlYnpQxIn1Yx/aGWTWweMAZN4Kw==',key_name='tempest-keypair-1627832457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-w89jx77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=21aec6af-f651-4a8c-9546-7a7180cd69ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG os_vif [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69e3c49c-41, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69e3c49c-41, col_values=(('external_ids', {'iface-id': '69e3c49c-41a9-4c43-9847-7ed25fd6b52f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:94:25', 'vm-uuid': '21aec6af-f651-4a8c-9546-7a7180cd69ad'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:08:59 user nova-compute[72620]: INFO os_vif [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41')
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:b5:94:25, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updated VIF entry in instance network info cache for port 69e3c49c-41a9-4c43-9847-7ed25fd6b52f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG nova.network.neutron [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updating instance_info_cache with network_info: [{"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:08:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-887f87d8-ecd4-48be-9434-59794c2aa607 req-766085b0-2ed4-4c5c-9b7d-73907d681c5a service nova] Releasing lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] No waiting events found dispatching network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:01 user nova-compute[72620]: WARNING nova.compute.manager [req-dbb6d324-1d79-4cc2-bc4a-ac0e3b5450ad req-3632bd35-de7d-483a-96ed-90dafface898 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received unexpected event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f for instance with vm_state building and task_state spawning.
Aug 09 21:09:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'pci_requests' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:09:01 user nova-compute[72620]: INFO nova.compute.claims [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Claim successful on node user
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:02 user nova-compute[72620]: INFO nova.network.neutron [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating port 66740ed3-6c0e-4436-b8cc-1091f0925a83 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615342.9593368, 21aec6af-f651-4a8c-9546-7a7180cd69ad => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:02 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] VM Resumed (Lifecycle Event)
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:09:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Instance spawned successfully.
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:09:02 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing instance network info cache due to event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615342.9627626, 21aec6af-f651-4a8c-9546-7a7180cd69ad => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] VM Started (Lifecycle Event)
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] No waiting events found dispatching network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:03 user nova-compute[72620]: WARNING nova.compute.manager [req-68d445eb-81c0-41eb-8146-60c46f8163db req-24220a2b-c620-44c1-a407-ccad28668538 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received unexpected event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f for instance with vm_state building and task_state spawning.
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.compute.manager [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Took 6.55 seconds to build instance.
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f902dfb0-8b8d-4d62-b91b-a762c903ec80 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.649s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.network.neutron [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:09:03 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Creating image(s)
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Did not create local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Ensure instance console log exists: /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start _get_guest_xml network_info=[{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c', 'attached_at': '', 'detached_at': '', 'volume_id': '980f76d7-d3be-4399-b616-c4e3351d8f79', 'serial': '980f76d7-d3be-4399-b616-c4e3351d8f79'}, 'delete_on_termination': True, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'b3f04b31-836f-4065-b6e9-2c7e1e4b35df', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:09:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:03 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:03 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:03 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:03 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66d0fd-55a7-41e9-bfa6-2fd9262c1ac1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:09:03 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e9d46-ee48-4ccc-92f6-bb9d2ca4a1de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79] added
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd641e-293d-4cf7-b4fc-31f3c0fb2422]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e6beb-0afa-4c82-b4cb-9bb91fa846d2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCSrNmPT {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCSrNmPT" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6847a735-d577-4a61-b4d6-2009327af1c7]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCSrNmPT'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a847db-822d-4e84-834b-9510a2f70aec]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4482be1a-862f-4aac-88a5-e32b62a9055f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[89275de9-616f-429f-8d96-3023d89891fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]
Aug 09 21:09:03 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e146da9d-785a-4a5a-bcd9-5a7c36a3362b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[905cce2b-e739-4e7d-a307-3db4926fe7e2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:03 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43b85c0-a019-48dd-8dde-4faa209a3b98]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updated VIF entry in instance network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-92a8d0cc-b129-47ef-8a07-d82db5ba4892 req-f540bb76-db7e-4591-b821-11058e102363 service nova] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23838613931306463', 'path': '/dev/sdd'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838613931306463', 'path': '/dev/sdd'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1479066823',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:08:53Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:09:04 user nova-compute[72620]:   <uuid>3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</uuid>
Aug 09 21:09:04 user nova-compute[72620]:   <name>instance-00000028</name>
Aug 09 21:09:04 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:09:04 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:09:04 user nova-compute[72620]:   <metadata>
Aug 09 21:09:04 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:09:04 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:09:04 user nova-compute[72620]:       <nova:name>tempest-TestShelveInstance-server-831123716</nova:name>
Aug 09 21:09:04 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:09:03</nova:creationTime>
Aug 09 21:09:04 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:09:04 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:09:04 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:09:04 user nova-compute[72620]:       <nova:owner>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:user uuid="5c8503e2bd8547d7b99ef24d6fd8398d">tempest-TestShelveInstance-413923288-project-member</nova:user>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:project uuid="4efc6fd7914d4901ad11164be89ce3b1">tempest-TestShelveInstance-413923288</nova:project>
Aug 09 21:09:04 user nova-compute[72620]:       </nova:owner>
Aug 09 21:09:04 user nova-compute[72620]:       <nova:ports>
Aug 09 21:09:04 user nova-compute[72620]:         <nova:port uuid="66740ed3-6c0e-4436-b8cc-1091f0925a83">
Aug 09 21:09:04 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 09 21:09:04 user nova-compute[72620]:         </nova:port>
Aug 09 21:09:04 user nova-compute[72620]:       </nova:ports>
Aug 09 21:09:04 user nova-compute[72620]:     </nova:instance>
Aug 09 21:09:04 user nova-compute[72620]:   </metadata>
Aug 09 21:09:04 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:09:04 user nova-compute[72620]:     <system>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="serial">3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</entry>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="uuid">3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c</entry>
Aug 09 21:09:04 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:09:04 user nova-compute[72620]:     </system>
Aug 09 21:09:04 user nova-compute[72620]:   </sysinfo>
Aug 09 21:09:04 user nova-compute[72620]:   <os>
Aug 09 21:09:04 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:09:04 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:09:04 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:09:04 user nova-compute[72620]:   </os>
Aug 09 21:09:04 user nova-compute[72620]:   <features>
Aug 09 21:09:04 user nova-compute[72620]:     <acpi/>
Aug 09 21:09:04 user nova-compute[72620]:     <apic/>
Aug 09 21:09:04 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:09:04 user nova-compute[72620]:   </features>
Aug 09 21:09:04 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:09:04 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:09:04 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:09:04 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:09:04 user nova-compute[72620]:   </clock>
Aug 09 21:09:04 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:09:04 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:09:04 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:09:04 user nova-compute[72620]:   </cpu>
Aug 09 21:09:04 user nova-compute[72620]:   <devices>
Aug 09 21:09:04 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:09:04 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:09:04 user nova-compute[72620]:       <source dev="/dev/sdd"/>
Aug 09 21:09:04 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:09:04 user nova-compute[72620]:       <serial>980f76d7-d3be-4399-b616-c4e3351d8f79</serial>
Aug 09 21:09:04 user nova-compute[72620]:     </disk>
Aug 09 21:09:04 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:09:04 user nova-compute[72620]:       <mac address="fa:16:3e:f3:78:f9"/>
Aug 09 21:09:04 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:09:04 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:09:04 user nova-compute[72620]:       <target dev="tap66740ed3-6c"/>
Aug 09 21:09:04 user nova-compute[72620]:     </interface>
Aug 09 21:09:04 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:09:04 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c/console.log" append="off"/>
Aug 09 21:09:04 user nova-compute[72620]:     </serial>
Aug 09 21:09:04 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:09:04 user nova-compute[72620]:     <video>
Aug 09 21:09:04 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:09:04 user nova-compute[72620]:     </video>
Aug 09 21:09:04 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:09:04 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:09:04 user nova-compute[72620]:     </rng>
Aug 09 21:09:04 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:09:04 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:09:04 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:09:04 user nova-compute[72620]:     </memballoon>
Aug 09 21:09:04 user nova-compute[72620]:   </devices>
Aug 09 21:09:04 user nova-compute[72620]: </domain>
Aug 09 21:09:04 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1479066823',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:08:53Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG os_vif [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66740ed3-6c, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap66740ed3-6c, col_values=(('external_ids', {'iface-id': '66740ed3-6c0e-4436-b8cc-1091f0925a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:78:f9', 'vm-uuid': '3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:09:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:05 user nova-compute[72620]: INFO os_vif [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c')
Aug 09 21:09:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:09:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] No VIF found with MAC fa:16:3e:f3:78:f9, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:06 user nova-compute[72620]: DEBUG nova.compute.manager [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:06 user nova-compute[72620]: WARNING nova.compute.manager [req-244ef2f3-a81b-4cd1-9b6e-2e4bc1176b94 req-a5cfabf0-38e5-4689-9557-84a4f073aa06 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 21:09:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615348.5405056, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:08 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Resumed (Lifecycle Event)
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:09:08 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance spawned successfully.
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:08 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615348.5423768, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:08 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Started (Lifecycle Event)
Aug 09 21:09:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a43bcb3a-2a08-47f7-bdec-ca58804b3f81 tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.527s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:08 user nova-compute[72620]: DEBUG nova.compute.manager [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:08 user nova-compute[72620]: WARNING nova.compute.manager [req-767794a5-187b-4364-9b88-09cb66d8c2b9 req-ed374da4-8e69-4422-af79-bbd6a7c9bade service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state active and task_state None.
Aug 09 21:09:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:10 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:11 user nova-compute[72620]: INFO nova.compute.manager [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attaching volume faef44d8-e08a-42b6-b51e-21e39b445c25 to /dev/vdb
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.utils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bbfa32-7d32-4089-a259-440eadef8481]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f4522-64b1-4a8b-93c8-e46c200f6559]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6500e4-d2ea-4862-b41a-3e40015e3fb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f4a1a-65cd-42b5-b61b-8d2255f8e99f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:09:11 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:09:11 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d6579-0d7b-4078-ad6e-5dd99edabef9]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG os_brick.utils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:11 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating existing volume attachment record: 229f78b0-a8bd-4402-9813-870e63d9343a {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:09:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG nova.compute.manager [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG nova.compute.manager [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing instance network info cache due to event network-changed-c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] Acquiring lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] Acquired lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG nova.network.neutron [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Refreshing network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:14 user nova-compute[72620]: INFO nova.compute.manager [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Terminating instance
Aug 09 21:09:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-unplugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] No waiting events found dispatching network-vif-unplugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-16de9c6a-83dc-4634-9754-71d1be7ecf5a req-d7f720e5-325d-4e01-8868-5fa9b973adc7 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-unplugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.network.neutron [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updated VIF entry in instance network info cache for port c77b195a-58b5-42ff-b1fe-0979b88f5019. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.network.neutron [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [{"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-134c4cd2-8ece-4e31-a314-8989bc5ccc7f req-82c4696b-219c-4c71-94a6-0c348375a6a9 service nova] Releasing lock "refresh_cache-26439232-cff4-4486-81aa-9c614fcbe097" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Instance destroyed successfully.
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.objects.instance [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lazy-loading 'resources' on Instance uuid 26439232-cff4-4486-81aa-9c614fcbe097 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-322203433',display_name='tempest-TestVolumeBootPattern-server-322203433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-322203433',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDEd4yK1uGidgIavVhKWMqwxthwfvuCQAS2fkDD/CfG9wCUlQH3WNG55oYfn0tf0xQr0F9fbNB5TVNPkNBkj9sWELe8vsxLtDpmAHdH/xAbX1hMvtmuhM+TJiHQriBftQ==',key_name='tempest-TestVolumeBootPattern-1522269491',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b81cadeef3dc4103a9cb724cb24ea671',ramdisk_id='',reservation_id='r-0q0hxtq1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2025401623',owner_user_name='tempest-TestVolumeBootPattern-2025401623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:04:29Z,user_data=None,user_id='2d65ef4e7f0a4bb0a66040199d6fff2a',uuid=26439232-cff4-4486-81aa-9c614fcbe097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converting VIF {"id": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "address": "fa:16:3e:5f:1f:a4", "network": {"id": "aa39d436-258a-4544-a106-9b8ce9336823", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-410067963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b81cadeef3dc4103a9cb724cb24ea671", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc77b195a-58", "ovs_interfaceid": "c77b195a-58b5-42ff-b1fe-0979b88f5019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_vif [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc77b195a-58, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:09:15 user nova-compute[72620]: INFO os_vif [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1f:a4,bridge_name='br-int',has_traffic_filtering=True,id=c77b195a-58b5-42ff-b1fe-0979b88f5019,network=Network(aa39d436-258a-4544-a106-9b8ce9336823),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc77b195a-58')
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZiqvhjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:15 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdc228e-02de-409b-9f9b-6341dbda1a97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4cf735-01f3-48aa-ba22-5b1c21e07f4a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305c91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f7777-09a3-4859-8375-3f1328f3668c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa93f2-3c42-43d0-a2f7-79d2387bdb03]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[604c0cc1-391e-4a2f-9660-5cfe38d48be9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788c29a-1eeb-492e-b9f3-1aa596e7952b]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bc663f-0c0f-48f4-8b54-843df8bee514]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[854049cd-6950-4544-8d26-39392a49e7a2]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260]
Aug 09 21:09:15 user nova-compute[72620]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33, portal: 172.16.0.220,3260] successful.
Aug 09 21:09:15 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f06b0a8-2394-49ca-99a4-102648900a33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d62e035-b27c-4341-abc6-56fdf6991d27]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] <== disconnect_volume: return (311ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:09:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Deleting instance files /opt/stack/data/nova/instances/26439232-cff4-4486-81aa-9c614fcbe097_del
Aug 09 21:09:15 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Deletion of /opt/stack/data/nova/instances/26439232-cff4-4486-81aa-9c614fcbe097_del complete
Aug 09 21:09:15 user nova-compute[72620]: INFO nova.compute.manager [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 09 21:09:15 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:09:15 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:16 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Took 0.62 seconds to deallocate network for instance.
Aug 09 21:09:16 user nova-compute[72620]: DEBUG nova.compute.manager [req-e9d086ee-0273-49e7-a57e-76e2d09daa3c req-64b76502-a26c-45f0-9a28-0e6dff00ce17 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-deleted-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:09:16 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] Acquiring lock "26439232-cff4-4486-81aa-9c614fcbe097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] Lock "26439232-cff4-4486-81aa-9c614fcbe097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] No waiting events found dispatching network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:17 user nova-compute[72620]: WARNING nova.compute.manager [req-944c6c56-534c-482d-bfa4-35587c30dc31 req-132cc350-5e5b-469d-a69b-ab6a6657fe80 service nova] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Received unexpected event network-vif-plugged-c77b195a-58b5-42ff-b1fe-0979b88f5019 for instance with vm_state active and task_state deleting.
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: INFO nova.compute.manager [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Took 0.86 seconds to detach 1 volumes for instance.
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:17 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Deleted allocations for instance 26439232-cff4-4486-81aa-9c614fcbe097
Aug 09 21:09:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-a0dd452b-7fe9-40d3-8450-2d6e29c96452 tempest-TestVolumeBootPattern-2025401623 tempest-TestVolumeBootPattern-2025401623-project-member] Lock "26439232-cff4-4486-81aa-9c614fcbe097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.863s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.238445281982422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:18 user nova-compute[72620]: INFO nova.compute.manager [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Unshelving
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 21aec6af-f651-4a8c-9546-7a7180cd69ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:09:18 user nova-compute[72620]: INFO nova.virt.block_device [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Booting with volume 5ef83866-d86e-40b7-a626-fe23d8d81fa5 at /dev/vdc
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.utils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d1d4d2-6837-4aba-bbe9-d941f84e6a7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c48dd-2ca7-4777-b868-1ce313b06da9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d85749-0bab-49af-9f91-1b54958e100c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866fd7d-0024-48d9-a37b-2c1739355c3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:09:18 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8764b-805b-4e7c-b3be-cbe27e172303]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG os_brick.utils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating existing volume attachment record: b3341e7a-c78c-484c-8d94-aebe70490c11 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:09:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuniABzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:20 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:20 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a52b0-3d4c-4ad3-a889-9913e5eeaa8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:09:20 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67916eb1-fc02-44e0-9a5b-3118b4d1d294]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25] added
Aug 09 21:09:20 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c83d9-47de-4230-80ae-61085051df31]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[be94fcf9-3c77-4577-aa7e-d7cec5a852e8]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuniABzr {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cuniABzr" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf9320-c632-4155-87b1-e5eadcba7daf]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cuniABzr'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c558bd58-e8d4-4547-8c32-e03d6c772ae2]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ef0c34-87f3-42bf-8647-a92f72f79b7c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fcbb83-10cc-405b-9d11-00b360a21fb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260]
Aug 09 21:09:21 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260] successful.
Aug 09 21:09:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1204e7-c5b5-4d9c-922f-5b904ea539ab]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb25eaf9-ce72-4a44-bc3c-2d8fb9484b77]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)
Aug 09 21:09:21 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[421b485b-dd49-45c6-8d8a-7556228c581b]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:09:21 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuniABzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23534356266616261', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534356266616261', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:09:22 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:09:22 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:09:22 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:09:22 user nova-compute[72620]:   <serial>faef44d8-e08a-42b6-b51e-21e39b445c25</serial>
Aug 09 21:09:22 user nova-compute[72620]: </disk>
Aug 09 21:09:22 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] No VIF found with MAC fa:16:3e:81:de:e3, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9c0db266-b6be-4317-91c0-5bad32afa499 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.404s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:25 user nova-compute[72620]: INFO nova.compute.manager [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Detaching volume faef44d8-e08a-42b6-b51e-21e39b445c25
Aug 09 21:09:25 user nova-compute[72620]: INFO nova.virt.block_device [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Attempting to driver detach volume faef44d8-e08a-42b6-b51e-21e39b445c25 from mountpoint /dev/vdb
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Attempting to detach device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:09:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:09:25 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:09:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:09:25 user nova-compute[72620]:   <serial>faef44d8-e08a-42b6-b51e-21e39b445c25</serial>
Aug 09 21:09:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:09:25 user nova-compute[72620]: </disk>
Aug 09 21:09:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:09:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the persistent domain config.
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:09:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:09:25 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:09:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:09:25 user nova-compute[72620]:   <serial>faef44d8-e08a-42b6-b51e-21e39b445c25</serial>
Aug 09 21:09:25 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:09:25 user nova-compute[72620]: </disk>
Aug 09 21:09:25 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615365.6632683, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:09:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully detached device vdb from instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 from the live domain config.
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cuniABzr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e706daad-3bb8-4967-b16c-ea29d1d0c139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7de78-bc90-4b41-978d-c4d6e4eaec2e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 (non-flash)
Aug 09 21:09:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3037a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60d7b7-ab3b-4f8d-9c07-bc88292c6a45]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a7ab7-fe98-42d3-9edf-b0bc447d9ccb]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da1e107-dd2f-4aeb-b1c5-43c783a65b2a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d2077-c8d9-44ad-afc6-f6b1e09e2571]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51003f-c828-4b81-8ff5-0ca995ac5e50]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[df255c8e-2eac-4073-ba91-fd523006f41a]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260]
Aug 09 21:09:25 user nova-compute[72620]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25, portal: 172.16.0.220,3260] successful.
Aug 09 21:09:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:faef44d8-e08a-42b6-b51e-21e39b445c25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0cec50-26c7-4803-b3d1-57b0cff0d3ef]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] <== disconnect_volume: return (267ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:09:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'flavor' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ca961d52-2a25-4a3d-9ac2-082bc75fed11 tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.804s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_requests' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'numa_topology' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:09:28 user nova-compute[72620]: INFO nova.compute.claims [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Claim successful on node user
Aug 09 21:09:28 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:09:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:28 user nova-compute[72620]: INFO nova.network.neutron [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating port ae913f60-005d-47f6-8cfe-9fcb620449f6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing instance network info cache due to event network-changed-ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:09:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:09:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Creating image(s)
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Refreshing network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615355.4887407, 26439232-cff4-4486-81aa-9c614fcbe097 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:31 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] VM Stopped (Lifecycle Event)
Aug 09 21:09:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-4f52a528-e12f-4e5a-8da3-982bf2b03028 None None] [instance: 26439232-cff4-4486-81aa-9c614fcbe097] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.virt.images [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] 53feb156-c2d6-4fea-9425-79b17783f60b was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.part /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.part /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.converted" returned: 0 in 0.235s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updated VIF entry in instance network info cache for port ae913f60-005d-47f6-8cfe-9fcb620449f6. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG nova.network.neutron [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b6ca84c-5e93-47b9-b85e-f492e48955d9 req-6f3bd065-6538-4acc-95e3-29d91439c53c service nova] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.413s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12,backing_fmt=raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12,backing_fmt=raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk 1073741824" returned: 0 in 0.047s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "97064c5d7e46e55ffdbda19a62a71693e0dfdb12" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:31 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'migration_context' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Rebasing disk image.
Aug 09 21:09:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d -F raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d -F raw /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk" returned: 0 in 2.044s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Ensure instance console log exists: /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start _get_guest_xml network_info=[{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='93afe713da0d811175ee2e7214c3291a',container_format='bare',created_at=2023-08-09T21:07:26Z,direct_url=<?>,disk_format='qcow2',id=53feb156-c2d6-4fea-9425-79b17783f60b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-700966194-shelved',owner='75043330db1b414d8ad64a41a5bf7fc6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T21:07:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GekOrBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6070294c-4df8-45cc-8d89-128df66bf0d4', 'attached_at': '', 'detached_at': '', 'volume_id': '5ef83866-d86e-40b7-a626-fe23d8d81fa5', 'serial': '5ef83866-d86e-40b7-a626-fe23d8d81fa5'}, 'delete_on_termination': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': 'b3341e7a-c78c-484c-8d94-aebe70490c11', 'guest_format': None, 'volume_type': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:09:34 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:34 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='93afe713da0d811175ee2e7214c3291a',container_format='bare',created_at=2023-08-09T21:07:26Z,direct_url=<?>,disk_format='qcow2',id=53feb156-c2d6-4fea-9425-79b17783f60b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-700966194-shelved',owner='75043330db1b414d8ad64a41a5bf7fc6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-09T21:07:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GekOrBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:09:34 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:34 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:09:34 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9dc788-f763-4e2a-b297-1552194d1581]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:09:34 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3e218-3d17-4fcc-9e94-fb667179bf98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5] added
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60948d1-01ca-4d90-a83b-58ce99971631]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb52ecb7-6a11-43d9-9b5b-36f0785e3db4]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GekOrBdz {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GekOrBdz" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[55106b12-2f06-476f-8159-19725e7ea5dd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GekOrBdz'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d62aef-49aa-4649-ba02-2b7afb6ee411]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48ecff3-b848-4914-8788-5bc49b9fa03d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca8c81a-1eb7-4fba-acdf-58bd7a22cdad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260]
Aug 09 21:09:34 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260] successful.
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[394cd13c-1a7f-449d-a8c2-e878e22f0d39]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829281d-5db8-416f-9db4-2cac7837c086]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:09:34 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7b3cb-8c4c-463b-9863-ba66ca259338]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:09:34 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GekOrBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26366633330323965', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366633330323965', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='53feb156-c2d6-4fea-9425-79b17783f60b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-629849260',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:07:29.894996',shelved_host='user',shelved_image_id='53feb156-c2d6-4fea-9425-79b17783f60b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_devices' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:09:35 user nova-compute[72620]:   <uuid>6070294c-4df8-45cc-8d89-128df66bf0d4</uuid>
Aug 09 21:09:35 user nova-compute[72620]:   <name>instance-00000029</name>
Aug 09 21:09:35 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:09:35 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:09:35 user nova-compute[72620]:   <metadata>
Aug 09 21:09:35 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:09:35 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-700966194</nova:name>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:09:34</nova:creationTime>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:09:35 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:09:35 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:owner>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:user uuid="321c1c40fcf24714ad1c224351ff217e">tempest-AttachVolumeShelveTestJSON-1153095829-project-member</nova:user>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:project uuid="75043330db1b414d8ad64a41a5bf7fc6">tempest-AttachVolumeShelveTestJSON-1153095829</nova:project>
Aug 09 21:09:35 user nova-compute[72620]:       </nova:owner>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:root type="image" uuid="53feb156-c2d6-4fea-9425-79b17783f60b"/>
Aug 09 21:09:35 user nova-compute[72620]:       <nova:ports>
Aug 09 21:09:35 user nova-compute[72620]:         <nova:port uuid="ae913f60-005d-47f6-8cfe-9fcb620449f6">
Aug 09 21:09:35 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 09 21:09:35 user nova-compute[72620]:         </nova:port>
Aug 09 21:09:35 user nova-compute[72620]:       </nova:ports>
Aug 09 21:09:35 user nova-compute[72620]:     </nova:instance>
Aug 09 21:09:35 user nova-compute[72620]:   </metadata>
Aug 09 21:09:35 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:09:35 user nova-compute[72620]:     <system>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="serial">6070294c-4df8-45cc-8d89-128df66bf0d4</entry>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="uuid">6070294c-4df8-45cc-8d89-128df66bf0d4</entry>
Aug 09 21:09:35 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:09:35 user nova-compute[72620]:     </system>
Aug 09 21:09:35 user nova-compute[72620]:   </sysinfo>
Aug 09 21:09:35 user nova-compute[72620]:   <os>
Aug 09 21:09:35 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:09:35 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:09:35 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:09:35 user nova-compute[72620]:   </os>
Aug 09 21:09:35 user nova-compute[72620]:   <features>
Aug 09 21:09:35 user nova-compute[72620]:     <acpi/>
Aug 09 21:09:35 user nova-compute[72620]:     <apic/>
Aug 09 21:09:35 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:09:35 user nova-compute[72620]:   </features>
Aug 09 21:09:35 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:09:35 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:09:35 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:09:35 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:09:35 user nova-compute[72620]:   </clock>
Aug 09 21:09:35 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:09:35 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:09:35 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:09:35 user nova-compute[72620]:   </cpu>
Aug 09 21:09:35 user nova-compute[72620]:   <devices>
Aug 09 21:09:35 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:09:35 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:09:35 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk"/>
Aug 09 21:09:35 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:09:35 user nova-compute[72620]:     </disk>
Aug 09 21:09:35 user nova-compute[72620]:     <disk type="block" device="disk">
Aug 09 21:09:35 user nova-compute[72620]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:09:35 user nova-compute[72620]:       <source dev="/dev/sdb"/>
Aug 09 21:09:35 user nova-compute[72620]:       <target dev="vdc" bus="virtio"/>
Aug 09 21:09:35 user nova-compute[72620]:       <serial>5ef83866-d86e-40b7-a626-fe23d8d81fa5</serial>
Aug 09 21:09:35 user nova-compute[72620]:     </disk>
Aug 09 21:09:35 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:09:35 user nova-compute[72620]:       <mac address="fa:16:3e:16:a7:40"/>
Aug 09 21:09:35 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:09:35 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:09:35 user nova-compute[72620]:       <target dev="tapae913f60-00"/>
Aug 09 21:09:35 user nova-compute[72620]:     </interface>
Aug 09 21:09:35 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:09:35 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/console.log" append="off"/>
Aug 09 21:09:35 user nova-compute[72620]:     </serial>
Aug 09 21:09:35 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:09:35 user nova-compute[72620]:     <video>
Aug 09 21:09:35 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:09:35 user nova-compute[72620]:     </video>
Aug 09 21:09:35 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:09:35 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:09:35 user nova-compute[72620]:     </rng>
Aug 09 21:09:35 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:09:35 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:09:35 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:09:35 user nova-compute[72620]:     </memballoon>
Aug 09 21:09:35 user nova-compute[72620]:   </devices>
Aug 09 21:09:35 user nova-compute[72620]: </domain>
Aug 09 21:09:35 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='53feb156-c2d6-4fea-9425-79b17783f60b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-629849260',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:07:29.894996',shelved_host='user',shelved_image_id='53feb156-c2d6-4fea-9425-79b17783f60b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG os_vif [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae913f60-00, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae913f60-00, col_values=(('external_ids', {'iface-id': 'ae913f60-005d-47f6-8cfe-9fcb620449f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:a7:40', 'vm-uuid': '6070294c-4df8-45cc-8d89-128df66bf0d4'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:35 user nova-compute[72620]: INFO os_vif [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00')
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:09:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No VIF found with MAC fa:16:3e:16:a7:40, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG nova.compute.manager [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:37 user nova-compute[72620]: WARNING nova.compute.manager [req-cc517b0b-0f1f-41b7-acab-be2797e757a0 req-f747069b-527a-4ec5-88ab-bb2d1c472db9 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615379.2396019, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Resumed (Lifecycle Event)
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:09:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance spawned successfully.
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615379.2417874, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:09:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Started (Lifecycle Event)
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:09:39 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:09:39 user nova-compute[72620]: WARNING nova.compute.manager [req-96753826-ebf7-4faf-95c0-63c2b98bca42 req-7d6b61d1-fe06-4a57-b390-8e94e6f98a85 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 21:09:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-80b789dd-c396-4a9c-95ff-4ed356a91aed tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:09:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:09:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:11 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:10:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:10:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:10:11 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:10:12 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [{"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:10:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-6070294c-4df8-45cc-8d89-128df66bf0d4" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:10:12 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:10:12 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:10:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:10:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:10:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8048MB free_disk=25.207874298095703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 21aec6af-f651-4a8c-9546-7a7180cd69ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:10:19 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:10:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:10:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:10:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:10:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:10:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:43 user nova-compute[72620]: DEBUG nova.compute.manager [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing instance network info cache due to event network-changed-66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:10:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] Acquiring lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:10:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] Acquired lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:10:43 user nova-compute[72620]: DEBUG nova.network.neutron [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Refreshing network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:44 user nova-compute[72620]: INFO nova.compute.manager [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Terminating instance
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updated VIF entry in instance network info cache for port 66740ed3-6c0e-4436-b8cc-1091f0925a83. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [{"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8ff0fa52-511f-4dfd-940f-178ca94bb986 req-a4d1c282-9fa0-4e27-b959-9a514180a405 service nova] Releasing lock "refresh_cache-3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-eb66441f-dd50-455e-94b3-e04a54319c32 req-67790c60-62b7-4c2b-9b8e-9d818cfdc2c3 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-unplugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Instance destroyed successfully.
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lazy-loading 'resources' on Instance uuid 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-831123716',display_name='tempest-TestShelveInstance-server-831123716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-831123716',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3HvjLT8m8blvWfC2jHWiOs5voJLbdry4tOgEM857ySi4jGg+2TpSgeUMb8MBXrKIpjSmVxBY7p76+GLrOsAaSg0x31EBn17X3RdRsOMn66L6vIFATbM9jky1qtLd/Gng==',key_name='tempest-TestShelveInstance-1479066823',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:09:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4efc6fd7914d4901ad11164be89ce3b1',ramdisk_id='',reservation_id='r-x1x776ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-413923288',owner_user_name='tempest-TestShelveInstance-413923288-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:09:09Z,user_data=None,user_id='5c8503e2bd8547d7b99ef24d6fd8398d',uuid=3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converting VIF {"id": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "address": "fa:16:3e:f3:78:f9", "network": {"id": "160d44bd-9d65-456d-ae82-7fa2ddf5ff62", "bridge": "br-int", "label": "tempest-TestShelveInstance-1349224980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4efc6fd7914d4901ad11164be89ce3b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66740ed3-6c", "ovs_interfaceid": "66740ed3-6c0e-4436-b8cc-1091f0925a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_vif [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66740ed3-6c, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:44 user nova-compute[72620]: INFO os_vif [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:78:f9,bridge_name='br-int',has_traffic_filtering=True,id=66740ed3-6c0e-4436-b8cc-1091f0925a83,network=Network(160d44bd-9d65-456d-ae82-7fa2ddf5ff62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66740ed3-6c')
Aug 09 21:10:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCSrNmPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:10:44 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[925bdfe8-4749-4bab-b108-6c56a4dc6251]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fd187-3c3e-4f1b-9e6a-eb094b191cea]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:10:44 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c305a2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79'): ({'sdd'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Removing single pathed devices sdd {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4ba90-5093-45e5-b1e3-5294b6b9c6a4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f0163a-6354-4832-b799-5fff5183792e]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Flushing IO for device /dev/sdd {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf82941-dc06-42f9-bd95-c93e93b86abd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:10:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf8b37d-0ff9-4e8e-89b6-6071807a74c1]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] SCSI volumes sdd have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_51335338', '/dev/disk/by-id/scsi-1SCST_BIO51335338-88a910dc57e1a204', '/dev/disk/by-id/scsi-23838613931306463') {{(pid=83828) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd691530-9f90-49eb-9b83-da34081df33e]: (4, None) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[843b03d8-87ef-451b-9a6b-951db56d9c2a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3041bc-ee70-45f7-bf71-effdf6bca732]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260]
Aug 09 21:10:45 user nova-compute[72620]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79, portal: 172.16.0.220,3260] successful.
Aug 09 21:10:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:980f76d7-d3be-4399-b616-c4e3351d8f79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1aaf68-3a2d-4820-bfd9-76a159dbc609]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] <== disconnect_volume: return (314ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:10:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deleting instance files /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c_del
Aug 09 21:10:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deletion of /opt/stack/data/nova/instances/3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c_del complete
Aug 09 21:10:45 user nova-compute[72620]: INFO nova.compute.manager [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 09 21:10:45 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:10:45 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:10:45 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Took 0.75 seconds to deallocate network for instance.
Aug 09 21:10:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-09c35791-fcef-45dd-9eb3-e0103a5bad1c req-5a433507-e536-4140-83d2-9cabb7df6de9 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-deleted-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] Acquiring lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:46 user nova-compute[72620]: DEBUG nova.compute.manager [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] No waiting events found dispatching network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:10:46 user nova-compute[72620]: WARNING nova.compute.manager [req-cd1a94fb-a378-4927-aee6-6ad7c0c19bcb req-3364ef38-10ab-4179-8a7f-eed98aa3dd49 service nova] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Received unexpected event network-vif-plugged-66740ed3-6c0e-4436-b8cc-1091f0925a83 for instance with vm_state active and task_state deleting.
Aug 09 21:10:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:48 user nova-compute[72620]: INFO nova.compute.manager [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Terminating instance
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-changed-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Refreshing instance network info cache due to event network-changed-69e3c49c-41a9-4c43-9847-7ed25fd6b52f. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] Acquiring lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] Acquired lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.network.neutron [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Refreshing network info cache for port 69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-unplugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] No waiting events found dispatching network-vif-unplugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:10:48 user nova-compute[72620]: DEBUG nova.compute.manager [req-e5081d56-6dec-4dc3-9951-ee68d743eb69 req-57b3ec54-095b-43b5-b5aa-9d83a259ad4c service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-unplugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updated VIF entry in instance network info cache for port 69e3c49c-41a9-4c43-9847-7ed25fd6b52f. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.network.neutron [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updating instance_info_cache with network_info: [{"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-cb43c416-880d-49fe-b88b-b6435d668ff4 req-0e94754c-3759-4819-8951-9e8e7ce8d381 service nova] Releasing lock "refresh_cache-21aec6af-f651-4a8c-9546-7a7180cd69ad" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:10:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Instance destroyed successfully.
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'resources' on Instance uuid 21aec6af-f651-4a8c-9546-7a7180cd69ad {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-521890085',display_name='tempest-AttachVolumeNegativeTest-server-521890085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-521890085',id=44,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcMoQJr2tWYeIwA4XpkigdIFn912+J1zOnrfwHo42ZfLSgNGkfwgXKDM7BrynpopO2444NSr1OJ77RXG3d+KRie2cJUDVKWv5kQ5eAXlYnpQxIn1Yx/aGWTWweMAZN4Kw==',key_name='tempest-keypair-1627832457',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-w89jx77f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=21aec6af-f651-4a8c-9546-7a7180cd69ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "address": "fa:16:3e:b5:94:25", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69e3c49c-41", "ovs_interfaceid": "69e3c49c-41a9-4c43-9847-7ed25fd6b52f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG os_vif [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69e3c49c-41, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:49 user nova-compute[72620]: INFO os_vif [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:94:25,bridge_name='br-int',has_traffic_filtering=True,id=69e3c49c-41a9-4c43-9847-7ed25fd6b52f,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69e3c49c-41')
Aug 09 21:10:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Deleting instance files /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad_del
Aug 09 21:10:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Deletion of /opt/stack/data/nova/instances/21aec6af-f651-4a8c-9546-7a7180cd69ad_del complete
Aug 09 21:10:49 user nova-compute[72620]: INFO nova.compute.manager [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 09 21:10:49 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:10:49 user nova-compute[72620]: INFO nova.compute.manager [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Took 3.96 seconds to detach 1 volumes for instance.
Aug 09 21:10:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Deleting volume: 980f76d7-d3be-4399-b616-c4e3351d8f79 {{(pid=72620) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:50 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Deleted allocations for instance 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ebcb3f29-2deb-49cc-9bfc-6ddf906d1d0e tempest-TestShelveInstance-413923288 tempest-TestShelveInstance-413923288-project-member] Lock "3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.516s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:10:50 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Took 1.18 seconds to deallocate network for instance.
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-97d0c9e4-b975-4418-98fa-fa917d308222 req-e4b35107-8dfb-4c32-9c47-b66be49888db service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-deleted-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:50 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Deleted allocations for instance 21aec6af-f651-4a8c-9546-7a7180cd69ad
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-181042ae-8141-45a1-8a3e-5622356a267f tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.405s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] Acquiring lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] Lock "21aec6af-f651-4a8c-9546-7a7180cd69ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:10:50 user nova-compute[72620]: DEBUG nova.compute.manager [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] No waiting events found dispatching network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:10:50 user nova-compute[72620]: WARNING nova.compute.manager [req-5285082e-efac-4b61-8b9e-65feae7eff84 req-520fa11c-6a2e-4898-ab15-33acd11e017f service nova] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Received unexpected event network-vif-plugged-69e3c49c-41a9-4c43-9847-7ed25fd6b52f for instance with vm_state deleted and task_state None.
Aug 09 21:10:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:10:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:10:59 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615444.8216045, 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:10:59 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] VM Stopped (Lifecycle Event)
Aug 09 21:10:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-e864472d-1d3d-4058-bb37-7cab5cb33220 None None] [instance: 3bf5ad86-cdb4-46cd-99ac-b7aae0332b3c] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:01 user nova-compute[72620]: INFO nova.compute.manager [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Terminating instance
Aug 09 21:11:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-unplugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] No waiting events found dispatching network-vif-unplugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.compute.manager [req-6bc98587-7709-47a2-abe6-7292ba83ad4d req-7d965d82-fc33-4edd-becd-2c341b696e3c service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-unplugged-9306159f-4b6c-42ad-9957-ec355802357f for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Instance destroyed successfully.
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lazy-loading 'resources' on Instance uuid 54aab7a9-83eb-43bc-ae55-8b3833abada3 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-853822473',display_name='tempest-SnapshotDataIntegrityTests-server-853822473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-853822473',id=38,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbbNlTXyfJaPRSl90/xntX514MbB4ow7Dbh+kn3Z4agLJredm/BOcIbdAFN32+l8vX5Y+2IQCdxZ2BMKeuxlZcsDPrM4Tyq7Xc9m5sE1zi+Ls257xxTA9ZlQJrncPhCRA==',key_name='tempest-keypair-770968057',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a2ad2cdd7144d01bd10765abff0eca9',ramdisk_id='',reservation_id='r-u3ghvezy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1699967733',owner_user_name='tempest-SnapshotDataIntegrityTests-1699967733-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bff591d26f9b4ebf93178b88c96fbe3a',uuid=54aab7a9-83eb-43bc-ae55-8b3833abada3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converting VIF {"id": "9306159f-4b6c-42ad-9957-ec355802357f", "address": "fa:16:3e:81:de:e3", "network": {"id": "d49b5ce0-31a6-466b-9dce-5628a1a4d51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1941356324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a2ad2cdd7144d01bd10765abff0eca9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9306159f-4b", "ovs_interfaceid": "9306159f-4b6c-42ad-9957-ec355802357f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG os_vif [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9306159f-4b, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:02 user nova-compute[72620]: INFO os_vif [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:de:e3,bridge_name='br-int',has_traffic_filtering=True,id=9306159f-4b6c-42ad-9957-ec355802357f,network=Network(d49b5ce0-31a6-466b-9dce-5628a1a4d51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9306159f-4b')
Aug 09 21:11:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Deleting instance files /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3_del
Aug 09 21:11:02 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Deletion of /opt/stack/data/nova/instances/54aab7a9-83eb-43bc-ae55-8b3833abada3_del complete
Aug 09 21:11:02 user nova-compute[72620]: INFO nova.compute.manager [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 09 21:11:02 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:11:02 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:11:03 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Took 0.88 seconds to deallocate network for instance.
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-04740561-e1ff-4b45-8c58-9484ae9a30d0 req-2e61f29b-44f3-4c76-a70d-658190fc1e6e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-deleted-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:03 user nova-compute[72620]: INFO nova.compute.manager [req-04740561-e1ff-4b45-8c58-9484ae9a30d0 req-2e61f29b-44f3-4c76-a70d-658190fc1e6e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Neutron deleted interface 9306159f-4b6c-42ad-9957-ec355802357f; detaching it from the instance and deleting it from the info cache
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.network.neutron [req-04740561-e1ff-4b45-8c58-9484ae9a30d0 req-2e61f29b-44f3-4c76-a70d-658190fc1e6e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-04740561-e1ff-4b45-8c58-9484ae9a30d0 req-2e61f29b-44f3-4c76-a70d-658190fc1e6e service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Detach interface failed, port_id=9306159f-4b6c-42ad-9957-ec355802357f, reason: Instance 54aab7a9-83eb-43bc-ae55-8b3833abada3 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:11:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:03 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Deleted allocations for instance 54aab7a9-83eb-43bc-ae55-8b3833abada3
Aug 09 21:11:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2852efc5-0bde-4031-bd77-23523f4027eb tempest-SnapshotDataIntegrityTests-1699967733 tempest-SnapshotDataIntegrityTests-1699967733-project-member] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] Acquiring lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:04 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] Lock "54aab7a9-83eb-43bc-ae55-8b3833abada3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:04 user nova-compute[72620]: DEBUG nova.compute.manager [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] No waiting events found dispatching network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:11:04 user nova-compute[72620]: WARNING nova.compute.manager [req-7418b387-4fcf-4db0-a8ef-36632c8419f1 req-90f356b3-9672-4dc9-8311-258dacdc45bd service nova] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Received unexpected event network-vif-plugged-9306159f-4b6c-42ad-9957-ec355802357f for instance with vm_state deleted and task_state None.
Aug 09 21:11:04 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615449.2774518, 21aec6af-f651-4a8c-9546-7a7180cd69ad => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:11:04 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] VM Stopped (Lifecycle Event)
Aug 09 21:11:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-6ab09f2d-5b91-4ab4-8bf5-6c8810adaf29 None None] [instance: 21aec6af-f651-4a8c-9546-7a7180cd69ad] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:08 user nova-compute[72620]: INFO nova.compute.manager [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Detaching volume 5ef83866-d86e-40b7-a626-fe23d8d81fa5
Aug 09 21:11:08 user nova-compute[72620]: INFO nova.virt.block_device [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Attempting to driver detach volume 5ef83866-d86e-40b7-a626-fe23d8d81fa5 from mountpoint /dev/vdc
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Attempting to detach device vdc from instance 6070294c-4df8-45cc-8d89-128df66bf0d4 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:11:08 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:11:08 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:11:08 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 21:11:08 user nova-compute[72620]:   <serial>5ef83866-d86e-40b7-a626-fe23d8d81fa5</serial>
Aug 09 21:11:08 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 21:11:08 user nova-compute[72620]: </disk>
Aug 09 21:11:08 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:11:08 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully detached device vdc from instance 6070294c-4df8-45cc-8d89-128df66bf0d4 from the persistent domain config.
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6070294c-4df8-45cc-8d89-128df66bf0d4 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:11:08 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:11:08 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:11:08 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 21:11:08 user nova-compute[72620]:   <serial>5ef83866-d86e-40b7-a626-fe23d8d81fa5</serial>
Aug 09 21:11:08 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 09 21:11:08 user nova-compute[72620]: </disk>
Aug 09 21:11:08 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615468.882645, 6070294c-4df8-45cc-8d89-128df66bf0d4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:11:08 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully detached device vdc from instance 6070294c-4df8-45cc-8d89-128df66bf0d4 from the live domain config.
Aug 09 21:11:08 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GekOrBdz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:11:08 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f022fcd9-d02d-4e3f-b517-3f801ca86892]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a2e7d0-33dc-404f-a93c-de910432b237]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:11:08 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:11:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:11:08 user nova-compute[72620]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 (non-flash)
Aug 09 21:11:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3030aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[028d0152-e291-4535-a443-b3da16b14f03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b07741c-3bd7-49b6-a95b-9d60a980668a]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:11:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f775a1b-9705-4ae3-acef-7b79d6435c20]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7775c453-980f-4888-88eb-d50e4a39ef84]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fb8fa-e68d-4faa-847f-6b83be5b2f25]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bd5e15-7683-4cb3-858c-3da9c7106f2e]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260]
Aug 09 21:11:09 user nova-compute[72620]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5, portal: 172.16.0.220,3260] successful.
Aug 09 21:11:09 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ef83866-d86e-40b7-a626-fe23d8d81fa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff4f08-0e41-46fe-97b4-28c5ca2a09ca]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] <== disconnect_volume: return (284ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'flavor' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08727833-ddf9-41bd-a3e4-0b887595abad tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:11 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:13 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:11:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:11:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:11:13 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:11:14 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:11:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:11:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:11:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615462.6286397, 54aab7a9-83eb-43bc-ae55-8b3833abada3 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:11:17 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] VM Stopped (Lifecycle Event)
Aug 09 21:11:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d7f5f96f-0202-4409-aa95-d5384af45f84 None None] [instance: 54aab7a9-83eb-43bc-ae55-8b3833abada3] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:11:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:11:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:11:18 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:11:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.253082275390625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:11:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:11:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:11:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:11:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:40 user nova-compute[72620]: INFO nova.compute.manager [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Detaching volume 55e469be-2fb6-4467-bf1a-9a5681e6cee1
Aug 09 21:11:40 user nova-compute[72620]: INFO nova.virt.block_device [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Attempting to driver detach volume 55e469be-2fb6-4467-bf1a-9a5681e6cee1 from mountpoint /dev/vdb
Aug 09 21:11:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Attempting to detach device vdb from instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:11:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:11:40 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:11:40 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:11:40 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:11:40 user nova-compute[72620]:   <serial>55e469be-2fb6-4467-bf1a-9a5681e6cee1</serial>
Aug 09 21:11:40 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:11:40 user nova-compute[72620]: </disk>
Aug 09 21:11:40 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:11:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 from the persistent domain config.
Aug 09 21:11:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:11:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:11:40 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:11:40 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:11:40 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:11:40 user nova-compute[72620]:   <serial>55e469be-2fb6-4467-bf1a-9a5681e6cee1</serial>
Aug 09 21:11:40 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:11:40 user nova-compute[72620]: </disk>
Aug 09 21:11:40 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615501.0637863, a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:11:41 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 from the live domain config.
Aug 09 21:11:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gsnQGXkd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:11:41 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87bdf6-ffd0-4ec2-835c-98eab2664af4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c49c0c-afa0-4864-a5b1-744e61061986]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:11:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 (non-flash)
Aug 09 21:11:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c3030b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef725fcb-cbda-43a8-93a9-6e28f5c22047]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[20556849-5b67-4141-82e0-f2444c01ec18]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707022d-6cf9-4d1d-bbce-68b57cfa1c41]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.068s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ef9b8-632c-41ab-92c3-39505685f7be]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95563ef-0e42-48a7-a450-d617997e0388]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1226ecb-ae76-4991-b0e9-1d1911835573]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260]
Aug 09 21:11:41 user nova-compute[72620]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1, portal: 172.16.0.220,3260] successful.
Aug 09 21:11:41 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e469be-2fb6-4467-bf1a-9a5681e6cee1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aaa04d-b660-4752-a3dd-981ecfa56103]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== disconnect_volume: return (340ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:11:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:11:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8c418f45-b39c-4245-ae9b-db4c013fdd21 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.835s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:11:49 user nova-compute[72620]: INFO nova.compute.claims [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Claim successful on node user
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:11:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:11:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Creating image(s)
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "/opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "/opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:49 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.policy [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48e87d71192540b1a638b0f37d79178a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48d4b6e18543ecb8206ef1d259038f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk 1073741824" returned: 0 in 0.048s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.objects.instance [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'migration_context' on Instance uuid f0ebb9cb-cc47-4e9a-89cb-50081eeb103d {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:50 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Successfully created port: e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:11:51 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Successfully updated port: e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquired lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-changed-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.compute.manager [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Refreshing instance network info cache due to event network-changed-e0130956-2803-415a-a55d-c27a8368e228. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] Acquiring lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updating instance_info_cache with network_info: [{"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Releasing lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Instance network_info: |[{"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] Acquired lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Refreshing network info cache for port e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Start _get_guest_xml network_info=[{"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:11:52 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:11:52 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-680783048',display_name='tempest-VolumesActionsTest-instance-680783048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-680783048',id=45,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-gx9a336o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:11:50Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=f0ebb9cb-cc47-4e9a-89cb-50081eeb103d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.objects.instance [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ebb9cb-cc47-4e9a-89cb-50081eeb103d {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:11:52 user nova-compute[72620]:   <uuid>f0ebb9cb-cc47-4e9a-89cb-50081eeb103d</uuid>
Aug 09 21:11:52 user nova-compute[72620]:   <name>instance-0000002d</name>
Aug 09 21:11:52 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:11:52 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:11:52 user nova-compute[72620]:   <metadata>
Aug 09 21:11:52 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:11:52 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:name>tempest-VolumesActionsTest-instance-680783048</nova:name>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:11:52</nova:creationTime>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:11:52 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:11:52 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:owner>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:user uuid="48e87d71192540b1a638b0f37d79178a">tempest-VolumesActionsTest-1295299424-project-member</nova:user>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:project uuid="4b48d4b6e18543ecb8206ef1d259038f">tempest-VolumesActionsTest-1295299424</nova:project>
Aug 09 21:11:52 user nova-compute[72620]:       </nova:owner>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:11:52 user nova-compute[72620]:       <nova:ports>
Aug 09 21:11:52 user nova-compute[72620]:         <nova:port uuid="e0130956-2803-415a-a55d-c27a8368e228">
Aug 09 21:11:52 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 09 21:11:52 user nova-compute[72620]:         </nova:port>
Aug 09 21:11:52 user nova-compute[72620]:       </nova:ports>
Aug 09 21:11:52 user nova-compute[72620]:     </nova:instance>
Aug 09 21:11:52 user nova-compute[72620]:   </metadata>
Aug 09 21:11:52 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:11:52 user nova-compute[72620]:     <system>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="serial">f0ebb9cb-cc47-4e9a-89cb-50081eeb103d</entry>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="uuid">f0ebb9cb-cc47-4e9a-89cb-50081eeb103d</entry>
Aug 09 21:11:52 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:11:52 user nova-compute[72620]:     </system>
Aug 09 21:11:52 user nova-compute[72620]:   </sysinfo>
Aug 09 21:11:52 user nova-compute[72620]:   <os>
Aug 09 21:11:52 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:11:52 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:11:52 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:11:52 user nova-compute[72620]:   </os>
Aug 09 21:11:52 user nova-compute[72620]:   <features>
Aug 09 21:11:52 user nova-compute[72620]:     <acpi/>
Aug 09 21:11:52 user nova-compute[72620]:     <apic/>
Aug 09 21:11:52 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:11:52 user nova-compute[72620]:   </features>
Aug 09 21:11:52 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:11:52 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:11:52 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:11:52 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:11:52 user nova-compute[72620]:   </clock>
Aug 09 21:11:52 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:11:52 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:11:52 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:11:52 user nova-compute[72620]:   </cpu>
Aug 09 21:11:52 user nova-compute[72620]:   <devices>
Aug 09 21:11:52 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:11:52 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:11:52 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk"/>
Aug 09 21:11:52 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:11:52 user nova-compute[72620]:     </disk>
Aug 09 21:11:52 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:11:52 user nova-compute[72620]:       <mac address="fa:16:3e:78:22:10"/>
Aug 09 21:11:52 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:11:52 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:11:52 user nova-compute[72620]:       <target dev="tape0130956-28"/>
Aug 09 21:11:52 user nova-compute[72620]:     </interface>
Aug 09 21:11:52 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:11:52 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/console.log" append="off"/>
Aug 09 21:11:52 user nova-compute[72620]:     </serial>
Aug 09 21:11:52 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:11:52 user nova-compute[72620]:     <video>
Aug 09 21:11:52 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:11:52 user nova-compute[72620]:     </video>
Aug 09 21:11:52 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:11:52 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:11:52 user nova-compute[72620]:     </rng>
Aug 09 21:11:52 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:11:52 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:11:52 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:11:52 user nova-compute[72620]:     </memballoon>
Aug 09 21:11:52 user nova-compute[72620]:   </devices>
Aug 09 21:11:52 user nova-compute[72620]: </domain>
Aug 09 21:11:52 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-680783048',display_name='tempest-VolumesActionsTest-instance-680783048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-680783048',id=45,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-gx9a336o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:11:50Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=f0ebb9cb-cc47-4e9a-89cb-50081eeb103d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG os_vif [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0130956-28, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0130956-28, col_values=(('external_ids', {'iface-id': 'e0130956-2803-415a-a55d-c27a8368e228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:22:10', 'vm-uuid': 'f0ebb9cb-cc47-4e9a-89cb-50081eeb103d'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:52 user nova-compute[72620]: INFO os_vif [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28')
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] No VIF found with MAC fa:16:3e:78:22:10, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updated VIF entry in instance network info cache for port e0130956-2803-415a-a55d-c27a8368e228. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG nova.network.neutron [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updating instance_info_cache with network_info: [{"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6879675c-279b-49eb-8c19-510681fcb306 req-a5358926-08a3-4f70-becc-7938385f1ff7 service nova] Releasing lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:11:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] No waiting events found dispatching network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:11:54 user nova-compute[72620]: WARNING nova.compute.manager [req-fa358b96-f49a-4d04-b598-4c72dce06886 req-fd137693-d8ad-4881-932c-0ab9378df237 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received unexpected event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 for instance with vm_state building and task_state spawning.
Aug 09 21:11:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615515.8541086, f0ebb9cb-cc47-4e9a-89cb-50081eeb103d => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] VM Resumed (Lifecycle Event)
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Instance spawned successfully.
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615515.8573222, f0ebb9cb-cc47-4e9a-89cb-50081eeb103d => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] VM Started (Lifecycle Event)
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:11:55 user nova-compute[72620]: INFO nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 09 21:11:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:11:56 user nova-compute[72620]: INFO nova.compute.manager [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Took 6.61 seconds to build instance.
Aug 09 21:11:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:56 user nova-compute[72620]: DEBUG nova.compute.manager [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] No waiting events found dispatching network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:11:56 user nova-compute[72620]: WARNING nova.compute.manager [req-d78e0a85-4d96-402f-86ff-1f68003c7c9b req-f89b2b26-8b24-4120-b6b5-9c77667ef308 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received unexpected event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 for instance with vm_state active and task_state None.
Aug 09 21:11:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-44acfb1b-11ac-47b8-8a2e-22563b5ab600 tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.695s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:58 user nova-compute[72620]: INFO nova.compute.manager [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Terminating instance
Aug 09 21:11:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-3d826de6-0aea-48cf-bbb6-49d363c295a0 req-44398fbc-b191-4a19-8e22-f7faea96b532 service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-unplugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Instance destroyed successfully.
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'resources' on Instance uuid 6070294c-4df8-45cc-8d89-128df66bf0d4 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-700966194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-700966194',id=41,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTS+9HyWtzG8zzYFJ5yEiELG8nmunC2LTFfSkxG7p5Ymt0M6e8zP/9RQ+OdEvUTnG0bRvEEPNpuptha4KyQq4rJ0CXRdiCxBIwOyOftihc1G7lNara27YCa5tes9I0lbQ==',key_name='tempest-keypair-629849260',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-grrz0hbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:09:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=6070294c-4df8-45cc-8d89-128df66bf0d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "address": "fa:16:3e:16:a7:40", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae913f60-00", "ovs_interfaceid": "ae913f60-005d-47f6-8cfe-9fcb620449f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG os_vif [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae913f60-00, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:11:59 user nova-compute[72620]: INFO os_vif [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:a7:40,bridge_name='br-int',has_traffic_filtering=True,id=ae913f60-005d-47f6-8cfe-9fcb620449f6,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae913f60-00')
Aug 09 21:11:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Deleting instance files /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4_del
Aug 09 21:11:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Deletion of /opt/stack/data/nova/instances/6070294c-4df8-45cc-8d89-128df66bf0d4_del complete
Aug 09 21:11:59 user nova-compute[72620]: INFO nova.compute.manager [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 09 21:11:59 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:11:59 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:00 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Took 1.00 seconds to deallocate network for instance.
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-822f4d17-dcab-4199-ab1d-96f11dc18250 req-cde25f59-be7d-4ca7-9ac1-4d81adb0ffae service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-deleted-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:00 user nova-compute[72620]: INFO nova.compute.manager [req-822f4d17-dcab-4199-ab1d-96f11dc18250 req-cde25f59-be7d-4ca7-9ac1-4d81adb0ffae service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Neutron deleted interface ae913f60-005d-47f6-8cfe-9fcb620449f6; detaching it from the instance and deleting it from the info cache
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.network.neutron [req-822f4d17-dcab-4199-ab1d-96f11dc18250 req-cde25f59-be7d-4ca7-9ac1-4d81adb0ffae service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.compute.manager [req-822f4d17-dcab-4199-ab1d-96f11dc18250 req-cde25f59-be7d-4ca7-9ac1-4d81adb0ffae service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Detach interface failed, port_id=ae913f60-005d-47f6-8cfe-9fcb620449f6, reason: Instance 6070294c-4df8-45cc-8d89-128df66bf0d4 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:12:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:00 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Deleted allocations for instance 6070294c-4df8-45cc-8d89-128df66bf0d4
Aug 09 21:12:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-35b41ab9-ac98-4c8d-a96f-765b5c09e04d tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] Acquiring lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] Lock "6070294c-4df8-45cc-8d89-128df66bf0d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] No waiting events found dispatching network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:01 user nova-compute[72620]: WARNING nova.compute.manager [req-e31057c3-08be-40db-bd67-40bb3efc0426 req-93b5936b-15f2-48ca-985c-de9505ba198f service nova] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Received unexpected event network-vif-plugged-ae913f60-005d-47f6-8cfe-9fcb620449f6 for instance with vm_state deleted and task_state None.
Aug 09 21:12:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:12:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:13 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615519.481572, 6070294c-4df8-45cc-8d89-128df66bf0d4 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:12:14 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] VM Stopped (Lifecycle Event)
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3c117560-1d1b-416d-8b4d-f1be6176ae19 None None] [instance: 6070294c-4df8-45cc-8d89-128df66bf0d4] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:12:14 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:12:15 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [{"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:12:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:12:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:12:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:12:19 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:12:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.248931884765625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f0ebb9cb-cc47-4e9a-89cb-50081eeb103d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:12:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:30 user nova-compute[72620]: INFO nova.compute.manager [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Terminating instance
Aug 09 21:12:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-0b3e2bee-7aa3-4f4b-b681-6e3edfa65f85 req-4ced7539-2216-4508-a37e-3076845bad9e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Instance destroyed successfully.
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'resources' on Instance uuid a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1344460308',display_name='tempest-AttachVolumeNegativeTest-server-1344460308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1344460308',id=43,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmkyFXouUOSCi8wnjgIXI9fEZ3uSgkG+a2jyCsjXHUPQz5jaawej8vl0nqTgBrfyNua1TSa3VWTLFNhqoLAVQNI7zwRKn69H/ziVd1Ua5R20tI225EAQU9Z944FyO/nSA==',key_name='tempest-keypair-1881507627',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-xpo23b2q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "11e42eee-f460-4d19-9116-f09d4edb1860", "address": "fa:16:3e:54:92:53", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11e42eee-f4", "ovs_interfaceid": "11e42eee-f460-4d19-9116-f09d4edb1860", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG os_vif [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11e42eee-f4, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:31 user nova-compute[72620]: INFO os_vif [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:92:53,bridge_name='br-int',has_traffic_filtering=True,id=11e42eee-f460-4d19-9116-f09d4edb1860,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11e42eee-f4')
Aug 09 21:12:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Deleting instance files /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0_del
Aug 09 21:12:31 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Deletion of /opt/stack/data/nova/instances/a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0_del complete
Aug 09 21:12:31 user nova-compute[72620]: INFO nova.compute.manager [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 21:12:31 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:12:31 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:12:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Took 0.96 seconds to deallocate network for instance.
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7aed3c6-2f5a-4a69-99e0-ba856b8dd24c req-0d6ecbf9-0311-479f-9857-0f1a85ec435e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-deleted-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:32 user nova-compute[72620]: INFO nova.compute.manager [req-b7aed3c6-2f5a-4a69-99e0-ba856b8dd24c req-0d6ecbf9-0311-479f-9857-0f1a85ec435e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Neutron deleted interface 11e42eee-f460-4d19-9116-f09d4edb1860; detaching it from the instance and deleting it from the info cache
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.network.neutron [req-b7aed3c6-2f5a-4a69-99e0-ba856b8dd24c req-0d6ecbf9-0311-479f-9857-0f1a85ec435e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-b7aed3c6-2f5a-4a69-99e0-ba856b8dd24c req-0d6ecbf9-0311-479f-9857-0f1a85ec435e service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Detach interface failed, port_id=11e42eee-f460-4d19-9116-f09d4edb1860, reason: Instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:12:32 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Deleted allocations for instance a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-61045568-6bbc-4e8f-bdda-928b84fa0866 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.169s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:33 user nova-compute[72620]: WARNING nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state deleted and task_state None.
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:33 user nova-compute[72620]: WARNING nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state deleted and task_state None.
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:33 user nova-compute[72620]: WARNING nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state deleted and task_state None.
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:33 user nova-compute[72620]: WARNING nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-unplugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state deleted and task_state None.
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Acquiring lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] Lock "a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] No waiting events found dispatching network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:33 user nova-compute[72620]: WARNING nova.compute.manager [req-8a8a285a-8582-4d84-812a-0efefa0097e3 req-0569dcf3-3fd1-43b9-a22b-9e2a0b98348d service nova] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Received unexpected event network-vif-plugged-11e42eee-f460-4d19-9116-f09d4edb1860 for instance with vm_state deleted and task_state None.
Aug 09 21:12:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:12:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:12:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:12:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:46 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615551.75782, a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:12:46 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] VM Stopped (Lifecycle Event)
Aug 09 21:12:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-1ecad351-b2fe-495f-9e9d-e6bd65a1aa47 None None] [instance: a44a7e75-3f32-4e3b-9e5f-9dccabfbf0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:12:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:12:53 user nova-compute[72620]: INFO nova.compute.claims [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Claim successful on node user
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:12:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:12:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Creating image(s)
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG nova.policy [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '321c1c40fcf24714ad1c224351ff217e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75043330db1b414d8ad64a41a5bf7fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk 1073741824" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Cannot resize image /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'migration_context' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:54 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Successfully created port: 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Successfully updated port: 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.compute.manager [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing instance network info cache due to event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.neutron [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance network_info: |[{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start _get_guest_xml network_info=[{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:12:55 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:12:55 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVkmrawaMOhndswjOP+RooUoZYZKBWmdm7X1o1OI4EHErzFap378cUiyyGyj3lYyN6A57MOHkrcKTpghzapNFCRCVAuAQ5PMBYCPcjKZkuFE6uW6br7T8RH1hROusi+Xw==',key_name='tempest-keypair-1369945133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.objects.instance [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_devices' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:12:55 user nova-compute[72620]:   <uuid>5384b00b-6425-4733-97a3-31724b4a1a2e</uuid>
Aug 09 21:12:55 user nova-compute[72620]:   <name>instance-0000002e</name>
Aug 09 21:12:55 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:12:55 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:12:55 user nova-compute[72620]:   <metadata>
Aug 09 21:12:55 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:12:55 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-325470435</nova:name>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:12:55</nova:creationTime>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:12:55 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:12:55 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:owner>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:user uuid="321c1c40fcf24714ad1c224351ff217e">tempest-AttachVolumeShelveTestJSON-1153095829-project-member</nova:user>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:project uuid="75043330db1b414d8ad64a41a5bf7fc6">tempest-AttachVolumeShelveTestJSON-1153095829</nova:project>
Aug 09 21:12:55 user nova-compute[72620]:       </nova:owner>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:12:55 user nova-compute[72620]:       <nova:ports>
Aug 09 21:12:55 user nova-compute[72620]:         <nova:port uuid="0bb34cba-25e7-4380-96a3-60deec744efb">
Aug 09 21:12:55 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 21:12:55 user nova-compute[72620]:         </nova:port>
Aug 09 21:12:55 user nova-compute[72620]:       </nova:ports>
Aug 09 21:12:55 user nova-compute[72620]:     </nova:instance>
Aug 09 21:12:55 user nova-compute[72620]:   </metadata>
Aug 09 21:12:55 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:12:55 user nova-compute[72620]:     <system>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="serial">5384b00b-6425-4733-97a3-31724b4a1a2e</entry>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="uuid">5384b00b-6425-4733-97a3-31724b4a1a2e</entry>
Aug 09 21:12:55 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:12:55 user nova-compute[72620]:     </system>
Aug 09 21:12:55 user nova-compute[72620]:   </sysinfo>
Aug 09 21:12:55 user nova-compute[72620]:   <os>
Aug 09 21:12:55 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:12:55 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:12:55 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:12:55 user nova-compute[72620]:   </os>
Aug 09 21:12:55 user nova-compute[72620]:   <features>
Aug 09 21:12:55 user nova-compute[72620]:     <acpi/>
Aug 09 21:12:55 user nova-compute[72620]:     <apic/>
Aug 09 21:12:55 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:12:55 user nova-compute[72620]:   </features>
Aug 09 21:12:55 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:12:55 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:12:55 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:12:55 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:12:55 user nova-compute[72620]:   </clock>
Aug 09 21:12:55 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:12:55 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:12:55 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:12:55 user nova-compute[72620]:   </cpu>
Aug 09 21:12:55 user nova-compute[72620]:   <devices>
Aug 09 21:12:55 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:12:55 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:12:55 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk"/>
Aug 09 21:12:55 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:12:55 user nova-compute[72620]:     </disk>
Aug 09 21:12:55 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:12:55 user nova-compute[72620]:       <mac address="fa:16:3e:7d:4c:ef"/>
Aug 09 21:12:55 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:12:55 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:12:55 user nova-compute[72620]:       <target dev="tap0bb34cba-25"/>
Aug 09 21:12:55 user nova-compute[72620]:     </interface>
Aug 09 21:12:55 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:12:55 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/console.log" append="off"/>
Aug 09 21:12:55 user nova-compute[72620]:     </serial>
Aug 09 21:12:55 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:12:55 user nova-compute[72620]:     <video>
Aug 09 21:12:55 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:12:55 user nova-compute[72620]:     </video>
Aug 09 21:12:55 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:12:55 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:12:55 user nova-compute[72620]:     </rng>
Aug 09 21:12:55 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:12:55 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:12:55 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:12:55 user nova-compute[72620]:     </memballoon>
Aug 09 21:12:55 user nova-compute[72620]:   </devices>
Aug 09 21:12:55 user nova-compute[72620]: </domain>
Aug 09 21:12:55 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVkmrawaMOhndswjOP+RooUoZYZKBWmdm7X1o1OI4EHErzFap378cUiyyGyj3lYyN6A57MOHkrcKTpghzapNFCRCVAuAQ5PMBYCPcjKZkuFE6uW6br7T8RH1hROusi+Xw==',key_name='tempest-keypair-1369945133',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG os_vif [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb34cba-25, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bb34cba-25, col_values=(('external_ids', {'iface-id': '0bb34cba-25e7-4380-96a3-60deec744efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:4c:ef', 'vm-uuid': '5384b00b-6425-4733-97a3-31724b4a1a2e'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:55 user nova-compute[72620]: INFO os_vif [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25')
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:12:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No VIF found with MAC fa:16:3e:7d:4c:ef, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:12:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated VIF entry in instance network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:12:56 user nova-compute[72620]: DEBUG nova.network.neutron [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:12:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-c6b32021-9742-4b19-8145-9017bc3927bd req-097bf62f-a332-4bfa-8132-59b297fa188f service nova] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG nova.compute.manager [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:57 user nova-compute[72620]: WARNING nova.compute.manager [req-8b2cb049-beb3-45c0-89c8-b31183771ead req-87468622-3c40-40f9-9166-5e1d12572e37 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state building and task_state spawning.
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615579.1392925, 5384b00b-6425-4733-97a3-31724b4a1a2e => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Resumed (Lifecycle Event)
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance spawned successfully.
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615579.1441917, 5384b00b-6425-4733-97a3-31724b4a1a2e => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Started (Lifecycle Event)
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Took 5.58 seconds to spawn the instance on the hypervisor.
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:12:59 user nova-compute[72620]: DEBUG nova.compute.manager [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:12:59 user nova-compute[72620]: WARNING nova.compute.manager [req-71e58062-07bb-4fa5-a640-b1022f19e70d req-5b9d2a9f-57c8-4cb1-afdf-fd6e4a1fccc7 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state building and task_state spawning.
Aug 09 21:12:59 user nova-compute[72620]: INFO nova.compute.manager [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Took 6.11 seconds to build instance.
Aug 09 21:12:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-85bc6972-e989-48df-9b1e-2c1ab516602b tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.205s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:13:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:13:15 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:13:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updating instance_info_cache with network_info: [{"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:13:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:13:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:13:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:18 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:13:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:13:20 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:13:20 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.248104095458984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f0ebb9cb-cc47-4e9a-89cb-50081eeb103d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5384b00b-6425-4733-97a3-31724b4a1a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:13:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:13:24 user nova-compute[72620]: INFO nova.compute.claims [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Claim successful on node user
Aug 09 21:13:24 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:13:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.policy [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8831d0d8fa4dd08c79611d77c6eae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4606478775694a338c2bc8d46ee3c4d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:13:25 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Creating image(s)
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk 1073741824" returned: 0 in 0.054s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Successfully created port: cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Cannot resize image /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'migration_context' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Ensure instance console log exists: /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Successfully updated port: cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquired lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-changed-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.compute.manager [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Refreshing instance network info cache due to event network-changed-cd69b166-e5ac-4331-bcab-883a3c008247. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] Acquiring lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Releasing lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Instance network_info: |[{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] Acquired lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.neutron [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Refreshing network info cache for port cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Start _get_guest_xml network_info=[{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:13:26 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:13:26 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-254465159',display_name='tempest-AttachVolumeNegativeTest-server-254465159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-254465159',id=47,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf1csMOHGXet1JrGqMsRlsWZ7yEvTg8QVbPXPjbkA/6ofUpfdGlUMPJTP5I4QuJyaGo6jC0V7RYF9Yl8cnU2MSI6dG2VL6V+IrtstHgn3kF+XecCyMONZHj8yu7Xzp9oA==',key_name='tempest-keypair-1022813621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-1175gfa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=9e585cc7-5953-49bd-9e66-8a789fc9866f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:13:26 user nova-compute[72620]:   <uuid>9e585cc7-5953-49bd-9e66-8a789fc9866f</uuid>
Aug 09 21:13:26 user nova-compute[72620]:   <name>instance-0000002f</name>
Aug 09 21:13:26 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:13:26 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:13:26 user nova-compute[72620]:   <metadata>
Aug 09 21:13:26 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:13:26 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeNegativeTest-server-254465159</nova:name>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:13:26</nova:creationTime>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:13:26 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:13:26 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:owner>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:user uuid="0e8831d0d8fa4dd08c79611d77c6eae8">tempest-AttachVolumeNegativeTest-1201906540-project-member</nova:user>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:project uuid="4606478775694a338c2bc8d46ee3c4d7">tempest-AttachVolumeNegativeTest-1201906540</nova:project>
Aug 09 21:13:26 user nova-compute[72620]:       </nova:owner>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:13:26 user nova-compute[72620]:       <nova:ports>
Aug 09 21:13:26 user nova-compute[72620]:         <nova:port uuid="cd69b166-e5ac-4331-bcab-883a3c008247">
Aug 09 21:13:26 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 21:13:26 user nova-compute[72620]:         </nova:port>
Aug 09 21:13:26 user nova-compute[72620]:       </nova:ports>
Aug 09 21:13:26 user nova-compute[72620]:     </nova:instance>
Aug 09 21:13:26 user nova-compute[72620]:   </metadata>
Aug 09 21:13:26 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:13:26 user nova-compute[72620]:     <system>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="serial">9e585cc7-5953-49bd-9e66-8a789fc9866f</entry>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="uuid">9e585cc7-5953-49bd-9e66-8a789fc9866f</entry>
Aug 09 21:13:26 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:13:26 user nova-compute[72620]:     </system>
Aug 09 21:13:26 user nova-compute[72620]:   </sysinfo>
Aug 09 21:13:26 user nova-compute[72620]:   <os>
Aug 09 21:13:26 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:13:26 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:13:26 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:13:26 user nova-compute[72620]:   </os>
Aug 09 21:13:26 user nova-compute[72620]:   <features>
Aug 09 21:13:26 user nova-compute[72620]:     <acpi/>
Aug 09 21:13:26 user nova-compute[72620]:     <apic/>
Aug 09 21:13:26 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:13:26 user nova-compute[72620]:   </features>
Aug 09 21:13:26 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:13:26 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:13:26 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:13:26 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:13:26 user nova-compute[72620]:   </clock>
Aug 09 21:13:26 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:13:26 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:13:26 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:13:26 user nova-compute[72620]:   </cpu>
Aug 09 21:13:26 user nova-compute[72620]:   <devices>
Aug 09 21:13:26 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:13:26 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:13:26 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk"/>
Aug 09 21:13:26 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:13:26 user nova-compute[72620]:     </disk>
Aug 09 21:13:26 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:13:26 user nova-compute[72620]:       <mac address="fa:16:3e:a6:e4:a8"/>
Aug 09 21:13:26 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:13:26 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:13:26 user nova-compute[72620]:       <target dev="tapcd69b166-e5"/>
Aug 09 21:13:26 user nova-compute[72620]:     </interface>
Aug 09 21:13:26 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:13:26 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/console.log" append="off"/>
Aug 09 21:13:26 user nova-compute[72620]:     </serial>
Aug 09 21:13:26 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:13:26 user nova-compute[72620]:     <video>
Aug 09 21:13:26 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:13:26 user nova-compute[72620]:     </video>
Aug 09 21:13:26 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:13:26 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:13:26 user nova-compute[72620]:     </rng>
Aug 09 21:13:26 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:13:26 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:13:26 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:13:26 user nova-compute[72620]:     </memballoon>
Aug 09 21:13:26 user nova-compute[72620]:   </devices>
Aug 09 21:13:26 user nova-compute[72620]: </domain>
Aug 09 21:13:26 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-254465159',display_name='tempest-AttachVolumeNegativeTest-server-254465159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-254465159',id=47,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf1csMOHGXet1JrGqMsRlsWZ7yEvTg8QVbPXPjbkA/6ofUpfdGlUMPJTP5I4QuJyaGo6jC0V7RYF9Yl8cnU2MSI6dG2VL6V+IrtstHgn3kF+XecCyMONZHj8yu7Xzp9oA==',key_name='tempest-keypair-1022813621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-1175gfa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=9e585cc7-5953-49bd-9e66-8a789fc9866f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG os_vif [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd69b166-e5, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd69b166-e5, col_values=(('external_ids', {'iface-id': 'cd69b166-e5ac-4331-bcab-883a3c008247', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:e4:a8', 'vm-uuid': '9e585cc7-5953-49bd-9e66-8a789fc9866f'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:13:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:26 user nova-compute[72620]: INFO os_vif [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5')
Aug 09 21:13:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:13:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:a6:e4:a8, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:13:27 user nova-compute[72620]: DEBUG nova.network.neutron [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updated VIF entry in instance network info cache for port cd69b166-e5ac-4331-bcab-883a3c008247. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:13:27 user nova-compute[72620]: DEBUG nova.network.neutron [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:13:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9508661f-b1a9-454b-ac60-488d29f62aaa req-e0235154-3d71-4f85-92b5-39abdcb466f5 service nova] Releasing lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] No waiting events found dispatching network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:13:28 user nova-compute[72620]: WARNING nova.compute.manager [req-6685fe2e-cf8f-44f7-b66d-f55430911bf5 req-58ed7bcb-f77d-4716-90b5-37a02c9a8351 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received unexpected event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 for instance with vm_state building and task_state spawning.
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615610.3851416, 9e585cc7-5953-49bd-9e66-8a789fc9866f => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] VM Resumed (Lifecycle Event)
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Instance spawned successfully.
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615610.3899124, 9e585cc7-5953-49bd-9e66-8a789fc9866f => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] VM Started (Lifecycle Event)
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] No waiting events found dispatching network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:13:30 user nova-compute[72620]: WARNING nova.compute.manager [req-70509a88-4304-4dbf-810a-0c1cde0d777f req-6ca97b06-fa08-491e-bad9-928ccf916023 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received unexpected event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 for instance with vm_state building and task_state spawning.
Aug 09 21:13:30 user nova-compute[72620]: INFO nova.compute.manager [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Took 5.88 seconds to build instance.
Aug 09 21:13:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-79ecc92e-a3d0-4a65-8a52-028515c03367 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.969s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:39 user nova-compute[72620]: INFO nova.compute.manager [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Terminating instance
Aug 09 21:13:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-unplugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] No waiting events found dispatching network-vif-unplugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.compute.manager [req-939e23c5-a4cc-401e-85ba-97a973633fc9 req-a4b91497-b616-496d-820b-fcc8df898062 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-unplugged-e0130956-2803-415a-a55d-c27a8368e228 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:13:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Instance destroyed successfully.
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.objects.instance [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'resources' on Instance uuid f0ebb9cb-cc47-4e9a-89cb-50081eeb103d {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:11:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-680783048',display_name='tempest-VolumesActionsTest-instance-680783048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-680783048',id=45,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:11:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-gx9a336o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:11:56Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=f0ebb9cb-cc47-4e9a-89cb-50081eeb103d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "e0130956-2803-415a-a55d-c27a8368e228", "address": "fa:16:3e:78:22:10", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0130956-28", "ovs_interfaceid": "e0130956-2803-415a-a55d-c27a8368e228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG os_vif [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0130956-28, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:40 user nova-compute[72620]: INFO os_vif [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:22:10,bridge_name='br-int',has_traffic_filtering=True,id=e0130956-2803-415a-a55d-c27a8368e228,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0130956-28')
Aug 09 21:13:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Deleting instance files /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d_del
Aug 09 21:13:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Deletion of /opt/stack/data/nova/instances/f0ebb9cb-cc47-4e9a-89cb-50081eeb103d_del complete
Aug 09 21:13:40 user nova-compute[72620]: INFO nova.compute.manager [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 09 21:13:40 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:13:40 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:13:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Took 0.77 seconds to deallocate network for instance.
Aug 09 21:13:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-1201987d-5aa9-466d-a23f-c673036d194c req-6b2c2d21-4fe5-4a31-9f48-038b3ff58e38 service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-deleted-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:13:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:41 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Deleted allocations for instance f0ebb9cb-cc47-4e9a-89cb-50081eeb103d
Aug 09 21:13:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-553b253d-3396-4b13-9e1d-a488fe22578a tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.092s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:13:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] Acquiring lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:13:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:13:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] Lock "f0ebb9cb-cc47-4e9a-89cb-50081eeb103d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:13:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] No waiting events found dispatching network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:13:42 user nova-compute[72620]: WARNING nova.compute.manager [req-03a93107-28f6-4e8e-9707-39f5c80e61f5 req-d87cac2c-f48c-45fa-9759-49bd1bb884eb service nova] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Received unexpected event network-vif-plugged-e0130956-2803-415a-a55d-c27a8368e228 for instance with vm_state deleted and task_state None.
Aug 09 21:13:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:55 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615620.7063663, f0ebb9cb-cc47-4e9a-89cb-50081eeb103d => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:13:55 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] VM Stopped (Lifecycle Event)
Aug 09 21:13:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-b6ea9db4-a704-4524-9038-c99df7fe1c8a None None] [instance: f0ebb9cb-cc47-4e9a-89cb-50081eeb103d] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:13:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:13:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:14 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:14:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:14:16 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:14:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:14:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:14:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:14:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:14:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.23678207397461GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5384b00b-6425-4733-97a3-31724b4a1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9e585cc7-5953-49bd-9e66-8a789fc9866f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:14:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:14:23 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:14:23 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:14:23 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:14:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:14:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:31 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:14:31 user nova-compute[72620]: INFO nova.compute.claims [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Claim successful on node user
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:14:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.policy [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48e87d71192540b1a638b0f37d79178a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b48d4b6e18543ecb8206ef1d259038f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:14:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Creating image(s)
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "/opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "/opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.126s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.129s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk 1073741824" returned: 0 in 0.051s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.126s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Cannot resize image /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'migration_context' on Instance uuid c6da6bea-0a29-43df-8a37-85e118041827 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Ensure instance console log exists: /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Successfully created port: 02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Successfully updated port: 02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquired lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-changed-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Refreshing instance network info cache due to event network-changed-02283a45-0b5f-456d-b300-f2ff0d6b6917. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] Acquiring lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.neutron [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Updating instance_info_cache with network_info: [{"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Releasing lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Instance network_info: |[{"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] Acquired lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Refreshing network info cache for port 02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Start _get_guest_xml network_info=[{"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:14:34 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:14:34 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:14:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-15091345',display_name='tempest-VolumesActionsTest-instance-15091345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-15091345',id=48,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-8g4120f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:14:32Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=c6da6bea-0a29-43df-8a37-85e118041827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'pci_devices' on Instance uuid c6da6bea-0a29-43df-8a37-85e118041827 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:14:34 user nova-compute[72620]:   <uuid>c6da6bea-0a29-43df-8a37-85e118041827</uuid>
Aug 09 21:14:34 user nova-compute[72620]:   <name>instance-00000030</name>
Aug 09 21:14:34 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:14:34 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:14:34 user nova-compute[72620]:   <metadata>
Aug 09 21:14:34 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:14:34 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:name>tempest-VolumesActionsTest-instance-15091345</nova:name>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:14:34</nova:creationTime>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:14:34 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:14:34 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:owner>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:user uuid="48e87d71192540b1a638b0f37d79178a">tempest-VolumesActionsTest-1295299424-project-member</nova:user>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:project uuid="4b48d4b6e18543ecb8206ef1d259038f">tempest-VolumesActionsTest-1295299424</nova:project>
Aug 09 21:14:34 user nova-compute[72620]:       </nova:owner>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:14:34 user nova-compute[72620]:       <nova:ports>
Aug 09 21:14:34 user nova-compute[72620]:         <nova:port uuid="02283a45-0b5f-456d-b300-f2ff0d6b6917">
Aug 09 21:14:34 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 09 21:14:34 user nova-compute[72620]:         </nova:port>
Aug 09 21:14:34 user nova-compute[72620]:       </nova:ports>
Aug 09 21:14:34 user nova-compute[72620]:     </nova:instance>
Aug 09 21:14:34 user nova-compute[72620]:   </metadata>
Aug 09 21:14:34 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:14:34 user nova-compute[72620]:     <system>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="serial">c6da6bea-0a29-43df-8a37-85e118041827</entry>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="uuid">c6da6bea-0a29-43df-8a37-85e118041827</entry>
Aug 09 21:14:34 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:14:34 user nova-compute[72620]:     </system>
Aug 09 21:14:34 user nova-compute[72620]:   </sysinfo>
Aug 09 21:14:34 user nova-compute[72620]:   <os>
Aug 09 21:14:34 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:14:34 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:14:34 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:14:34 user nova-compute[72620]:   </os>
Aug 09 21:14:34 user nova-compute[72620]:   <features>
Aug 09 21:14:34 user nova-compute[72620]:     <acpi/>
Aug 09 21:14:34 user nova-compute[72620]:     <apic/>
Aug 09 21:14:34 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:14:34 user nova-compute[72620]:   </features>
Aug 09 21:14:34 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:14:34 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:14:34 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:14:34 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:14:34 user nova-compute[72620]:   </clock>
Aug 09 21:14:34 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:14:34 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:14:34 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:14:34 user nova-compute[72620]:   </cpu>
Aug 09 21:14:34 user nova-compute[72620]:   <devices>
Aug 09 21:14:34 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:14:34 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:14:34 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk"/>
Aug 09 21:14:34 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:14:34 user nova-compute[72620]:     </disk>
Aug 09 21:14:34 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:14:34 user nova-compute[72620]:       <mac address="fa:16:3e:db:59:ca"/>
Aug 09 21:14:34 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:14:34 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:14:34 user nova-compute[72620]:       <target dev="tap02283a45-0b"/>
Aug 09 21:14:34 user nova-compute[72620]:     </interface>
Aug 09 21:14:34 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:14:34 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/console.log" append="off"/>
Aug 09 21:14:34 user nova-compute[72620]:     </serial>
Aug 09 21:14:34 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:14:34 user nova-compute[72620]:     <video>
Aug 09 21:14:34 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:14:34 user nova-compute[72620]:     </video>
Aug 09 21:14:34 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:14:34 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:14:34 user nova-compute[72620]:     </rng>
Aug 09 21:14:34 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:14:34 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:14:34 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:14:34 user nova-compute[72620]:     </memballoon>
Aug 09 21:14:34 user nova-compute[72620]:   </devices>
Aug 09 21:14:34 user nova-compute[72620]: </domain>
Aug 09 21:14:34 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:14:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-15091345',display_name='tempest-VolumesActionsTest-instance-15091345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-15091345',id=48,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-8g4120f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:14:32Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=c6da6bea-0a29-43df-8a37-85e118041827,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG os_vif [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02283a45-0b, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02283a45-0b, col_values=(('external_ids', {'iface-id': '02283a45-0b5f-456d-b300-f2ff0d6b6917', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:59:ca', 'vm-uuid': 'c6da6bea-0a29-43df-8a37-85e118041827'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:34 user nova-compute[72620]: INFO os_vif [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b')
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] No VIF found with MAC fa:16:3e:db:59:ca, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Updated VIF entry in instance network info cache for port 02283a45-0b5f-456d-b300-f2ff0d6b6917. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG nova.network.neutron [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Updating instance_info_cache with network_info: [{"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-56a91cc7-3361-49de-9211-29faef710d9e req-0e7b917d-293a-4501-b108-77a247fd6ef3 service nova] Releasing lock "refresh_cache-c6da6bea-0a29-43df-8a37-85e118041827" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:35 user nova-compute[72620]: DEBUG nova.compute.manager [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] No waiting events found dispatching network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:14:35 user nova-compute[72620]: WARNING nova.compute.manager [req-99174a74-799b-477b-854d-a1a1d517475b req-25c6423e-cb74-4805-b3d2-ba41f0fde3df service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received unexpected event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 for instance with vm_state building and task_state spawning.
Aug 09 21:14:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615677.655906, c6da6bea-0a29-43df-8a37-85e118041827 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] VM Resumed (Lifecycle Event)
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Instance spawned successfully.
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615677.657387, c6da6bea-0a29-43df-8a37-85e118041827 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] VM Started (Lifecycle Event)
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 09 21:14:37 user nova-compute[72620]: DEBUG nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:14:37 user nova-compute[72620]: INFO nova.compute.manager [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Took 6.02 seconds to build instance.
Aug 09 21:14:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-c9b6202e-2966-4974-a950-a9f07dfbaa3c tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:38 user nova-compute[72620]: DEBUG nova.compute.manager [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] No waiting events found dispatching network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:14:38 user nova-compute[72620]: WARNING nova.compute.manager [req-4fb85ce7-a74e-448e-9f63-b25034fd5475 req-a74b2d75-a478-4050-8a0f-bd5f4b29ec91 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received unexpected event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 for instance with vm_state active and task_state None.
Aug 09 21:14:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG nova.compute.manager [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing instance network info cache due to event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated VIF entry in instance network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6d1219e-2bc2-4295-a99f-35778b268b14 req-ed8a5f32-de6c-4573-acf9-089d2ee37a99 service nova] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:49 user nova-compute[72620]: INFO nova.compute.manager [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Shelving
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:14:49 user nova-compute[72620]: WARNING nova.compute.manager [req-2ab8fedd-0a65-405a-a639-8b2a9088eb42 req-f82d925d-9ccf-4576-a92a-4a992294b4f8 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state active and task_state shelving.
Aug 09 21:14:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance destroyed successfully.
Aug 09 21:14:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Beginning cold snapshot process
Aug 09 21:14:50 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 21:14:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk /opt/stack/data/nova/instances/snapshots/tmpyphm0an7/0059f3ccc4ed496db1096a4263ecf986 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:14:50 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk /opt/stack/data/nova/instances/snapshots/tmpyphm0an7/0059f3ccc4ed496db1096a4263ecf986" returned: 0 in 0.577s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:14:50 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Snapshot extracted, beginning image upload
Aug 09 21:14:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:14:51 user nova-compute[72620]: WARNING nova.compute.manager [req-eae01482-a92a-4166-bef9-50a3c5580225 req-34548fec-4a9b-425a-8773-4c6c790d8775 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state active and task_state shelving_image_uploading.
Aug 09 21:14:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Snapshot image upload complete
Aug 09 21:14:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:53 user nova-compute[72620]: INFO nova.compute.manager [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Shelve offloading
Aug 09 21:14:53 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance destroyed successfully.
Aug 09 21:14:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG nova.network.neutron [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:54 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance destroyed successfully.
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'resources' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVkmrawaMOhndswjOP+RooUoZYZKBWmdm7X1o1OI4EHErzFap378cUiyyGyj3lYyN6A57MOHkrcKTpghzapNFCRCVAuAQ5PMBYCPcjKZkuFE6uW6br7T8RH1hROusi+Xw==',key_name='tempest-keypair-1369945133',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:14:53.032527',shelved_host='user',shelved_image_id='c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG os_vif [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb34cba-25, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:14:54 user nova-compute[72620]: INFO os_vif [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25')
Aug 09 21:14:54 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Deleting instance files /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e_del
Aug 09 21:14:54 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Deletion of /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e_del complete
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.compute.manager [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing instance network info cache due to event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:14:54 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Deleted allocations for instance 5384b00b-6425-4733-97a3-31724b4a1a2e
Aug 09 21:14:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:14:54 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'numa_topology' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ae747419-9789-4fae-887c-243889cfd348 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.977s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated VIF entry in instance network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG nova.network.neutron [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0bb34cba-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:14:55 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-9d0e0d0b-2750-47f5-aa10-4efe7b6ff43d req-fe000c25-a672-48e0-b150-3ac65209f55a service nova] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:14:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:14:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:04 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615689.9075904, 5384b00b-6425-4733-97a3-31724b4a1a2e => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:15:04 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Stopped (Lifecycle Event)
Aug 09 21:15:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d2173019-7f88-4765-aeb3-160f32c6f3cc None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:15:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-changed-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:15:15 user nova-compute[72620]: DEBUG nova.compute.manager [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Refreshing instance network info cache due to event network-changed-cd69b166-e5ac-4331-bcab-883a3c008247. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:15:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] Acquiring lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:15:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] Acquired lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:15:15 user nova-compute[72620]: DEBUG nova.network.neutron [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Refreshing network info cache for port cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG nova.network.neutron [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updated VIF entry in instance network info cache for port cd69b166-e5ac-4331-bcab-883a3c008247. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG nova.network.neutron [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-879efc03-c075-4b08-9181-ec38c170d9e1 req-838cc2df-1dc2-4237-8f63-bd7ecfd22263 service nova] Releasing lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:15:16 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:15:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:15:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:15:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:15:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:15:19 user nova-compute[72620]: INFO nova.compute.manager [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Attaching volume c46e8448-e593-4f0d-a4bc-7da5897dc223 to /dev/vdb
Aug 09 21:15:19 user nova-compute[72620]: DEBUG os_brick.utils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f0353c-a6c8-475a-8724-c90b2e3f21b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5d5bd6-25c0-4600-bb86-5a6826c27064]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b279d6df-8a70-4c33-8908-3ceb9fecfed8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b123a-6969-4eab-bc9b-bb4c33b84f1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:19 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:15:20 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:15:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ff894-6841-4678-94a7-b65cf7de8d6e]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG os_brick.utils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:15:20 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating existing volume attachment record: f38886b4-b776-44ee-a008-abad78a08daf {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:15:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:15:22 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:15:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.18585205078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9e585cc7-5953-49bd-9e66-8a789fc9866f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance c6da6bea-0a29-43df-8a37-85e118041827 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:15:22 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:15:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:23 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:15:23 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:15:23 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:15:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:15:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:15:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvgbqQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:15:33 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:15:33 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:15:33 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefdc4ac-0434-4443-a566-dfe655a77488]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:15:33 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d08230-d3f3-42b0-b259-9e10491cf267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223] added
Aug 09 21:15:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa71672-7c66-468e-bf67-38550af8e04b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0088933-1a22-4a90-b664-ed20de851737]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvgbqQwM {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SvgbqQwM" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[891352bb-b627-4a76-a24e-94f4b6dc32f0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SvgbqQwM'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9ff308-3c39-4c86-bbc6-97be17571555]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8560bfb3-e509-495e-83a6-d19f74e503b0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:15:33 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:15:33 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:15:33 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:15:33 user nova-compute[72620]: 
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da7f94-8667-4e76-badf-6c06a9d30b21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260]
Aug 09 21:15:33 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260] successful.
Aug 09 21:15:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa500e3f-5513-4bb5-97c5-b1bb6380e553]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93d9a35-76e2-4d9f-9aba-a67853ff1ace]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)
Aug 09 21:15:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)
Aug 09 21:15:33 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd706d5-9252-4fe7-95cc-2e6818c81391]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:15:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvgbqQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23439393961393535', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439393961393535', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:15:34 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:15:34 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:15:34 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:15:34 user nova-compute[72620]:   <serial>c46e8448-e593-4f0d-a4bc-7da5897dc223</serial>
Aug 09 21:15:34 user nova-compute[72620]: </disk>
Aug 09 21:15:34 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:15:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:15:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:15:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:a6:e4:a8, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:15:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3c45644d-b2db-4bc9-a75f-3f5f0c7eb01e tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.407s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:15:36 user nova-compute[72620]: INFO nova.compute.manager [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Detaching volume c46e8448-e593-4f0d-a4bc-7da5897dc223
Aug 09 21:15:36 user nova-compute[72620]: INFO nova.virt.block_device [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Attempting to driver detach volume c46e8448-e593-4f0d-a4bc-7da5897dc223 from mountpoint /dev/vdb
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Attempting to detach device vdb from instance 9e585cc7-5953-49bd-9e66-8a789fc9866f from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:15:36 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:15:36 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:15:36 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:15:36 user nova-compute[72620]:   <serial>c46e8448-e593-4f0d-a4bc-7da5897dc223</serial>
Aug 09 21:15:36 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:15:36 user nova-compute[72620]: </disk>
Aug 09 21:15:36 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:15:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance 9e585cc7-5953-49bd-9e66-8a789fc9866f from the persistent domain config.
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e585cc7-5953-49bd-9e66-8a789fc9866f from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:15:36 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:15:36 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:15:36 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:15:36 user nova-compute[72620]:   <serial>c46e8448-e593-4f0d-a4bc-7da5897dc223</serial>
Aug 09 21:15:36 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:15:36 user nova-compute[72620]: </disk>
Aug 09 21:15:36 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615736.8304226, 9e585cc7-5953-49bd-9e66-8a789fc9866f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:15:36 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance 9e585cc7-5953-49bd-9e66-8a789fc9866f from the live domain config.
Aug 09 21:15:36 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SvgbqQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:15:36 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c6a52e-3997-48fb-9c49-613614e8d795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f55a5b9-b0f3-4a7d-a0d5-4c0b04f32bae]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)
Aug 09 21:15:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 (non-flash)
Aug 09 21:15:36 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30502050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c251f5-52ea-4097-9844-61a2c4d10516]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[683cb611-2ecd-47b5-9a02-790d7fc18f8c]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e30eec-1e47-45c7-b226-01acc7412bc5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:15:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f504098f-7c6d-4cc6-bad7-d3db73a2413f]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e1b3bc-4ed0-41f7-b9d0-7ea25be08445]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b9025c-2be0-4294-b7d4-83e6ff26ca19]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260]
Aug 09 21:15:37 user nova-compute[72620]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223, portal: 172.16.0.220,3260] successful.
Aug 09 21:15:37 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c46e8448-e593-4f0d-a4bc-7da5897dc223 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa2e07-2b2f-4371-8827-155daf356dde]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== disconnect_volume: return (274ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:15:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d240009f-f402-4801-a69d-0a71027fca12 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:15:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:15:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:15:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:15:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:16:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:16:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:18 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [{"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:18 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-9e585cc7-5953-49bd-9e66-8a789fc9866f" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:16:18 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:16:18 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:22 user nova-compute[72620]: INFO nova.compute.manager [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Terminating instance
Aug 09 21:16:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-unplugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] No waiting events found dispatching network-vif-unplugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-0bcf5b81-2bd2-4ce9-982b-bfa42c2a9a1e req-1cd6fc02-87e5-4507-b2c3-091943ebaad8 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-unplugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:16:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Instance destroyed successfully.
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lazy-loading 'resources' on Instance uuid c6da6bea-0a29-43df-8a37-85e118041827 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:14:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-15091345',display_name='tempest-VolumesActionsTest-instance-15091345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-15091345',id=48,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b48d4b6e18543ecb8206ef1d259038f',ramdisk_id='',reservation_id='r-8g4120f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1295299424',owner_user_name='tempest-VolumesActionsTest-1295299424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:14:38Z,user_data=None,user_id='48e87d71192540b1a638b0f37d79178a',uuid=c6da6bea-0a29-43df-8a37-85e118041827,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converting VIF {"id": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "address": "fa:16:3e:db:59:ca", "network": {"id": "19a85779-61c8-45fa-86aa-047512dab802", "bridge": "br-int", "label": "tempest-VolumesActionsTest-667598266-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b48d4b6e18543ecb8206ef1d259038f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02283a45-0b", "ovs_interfaceid": "02283a45-0b5f-456d-b300-f2ff0d6b6917", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG os_vif [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02283a45-0b, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:23 user nova-compute[72620]: INFO os_vif [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:59:ca,bridge_name='br-int',has_traffic_filtering=True,id=02283a45-0b5f-456d-b300-f2ff0d6b6917,network=Network(19a85779-61c8-45fa-86aa-047512dab802),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02283a45-0b')
Aug 09 21:16:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Deleting instance files /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827_del
Aug 09 21:16:23 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Deletion of /opt/stack/data/nova/instances/c6da6bea-0a29-43df-8a37-85e118041827_del complete
Aug 09 21:16:23 user nova-compute[72620]: INFO nova.compute.manager [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Took 0.64 seconds to destroy the instance on the hypervisor.
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:23 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Took 0.57 seconds to deallocate network for instance.
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.compute.manager [req-b1eed58d-eab2-4fbd-a5dc-cf4304dcd42e req-3a662af7-b444-49c0-973c-36ab47e15473 service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-deleted-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:23 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:24 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Deleted allocations for instance c6da6bea-0a29-43df-8a37-85e118041827
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f1cbc670-911f-4ad1-a015-1c75cd82199f tempest-VolumesActionsTest-1295299424 tempest-VolumesActionsTest-1295299424-project-member] Lock "c6da6bea-0a29-43df-8a37-85e118041827" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:16:24 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=25.212642669677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 9e585cc7-5953-49bd-9e66-8a789fc9866f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:16:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] Acquiring lock "c6da6bea-0a29-43df-8a37-85e118041827-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] Lock "c6da6bea-0a29-43df-8a37-85e118041827-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] No waiting events found dispatching network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:25 user nova-compute[72620]: WARNING nova.compute.manager [req-8fcbd040-6686-4fef-87c1-2151a7277037 req-0ce85087-0982-4f16-99d3-a45d46f1d14d service nova] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Received unexpected event network-vif-plugged-02283a45-0b5f-456d-b300-f2ff0d6b6917 for instance with vm_state deleted and task_state None.
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:26 user nova-compute[72620]: INFO nova.compute.manager [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Terminating instance
Aug 09 21:16:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-unplugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] No waiting events found dispatching network-vif-unplugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-ae5fdae6-b040-4089-93c2-dd9fc1f79b4d req-df15cdcb-a470-4bf8-a765-47376d770d17 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-unplugged-cd69b166-e5ac-4331-bcab-883a3c008247 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:16:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Instance destroyed successfully.
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.objects.instance [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'resources' on Instance uuid 9e585cc7-5953-49bd-9e66-8a789fc9866f {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:13:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-254465159',display_name='tempest-AttachVolumeNegativeTest-server-254465159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-254465159',id=47,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf1csMOHGXet1JrGqMsRlsWZ7yEvTg8QVbPXPjbkA/6ofUpfdGlUMPJTP5I4QuJyaGo6jC0V7RYF9Yl8cnU2MSI6dG2VL6V+IrtstHgn3kF+XecCyMONZHj8yu7Xzp9oA==',key_name='tempest-keypair-1022813621',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-1175gfa8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:13:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=9e585cc7-5953-49bd-9e66-8a789fc9866f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "cd69b166-e5ac-4331-bcab-883a3c008247", "address": "fa:16:3e:a6:e4:a8", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd69b166-e5", "ovs_interfaceid": "cd69b166-e5ac-4331-bcab-883a3c008247", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG os_vif [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd69b166-e5, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:27 user nova-compute[72620]: INFO os_vif [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:e4:a8,bridge_name='br-int',has_traffic_filtering=True,id=cd69b166-e5ac-4331-bcab-883a3c008247,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd69b166-e5')
Aug 09 21:16:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Deleting instance files /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f_del
Aug 09 21:16:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Deletion of /opt/stack/data/nova/instances/9e585cc7-5953-49bd-9e66-8a789fc9866f_del complete
Aug 09 21:16:27 user nova-compute[72620]: INFO nova.compute.manager [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 09 21:16:27 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:16:27 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:28 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Took 0.78 seconds to deallocate network for instance.
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-1c43378b-93a0-44a5-8238-2abfba8c1b2d req-513eef0d-17f3-4206-94ab-7af721878309 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-deleted-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:28 user nova-compute[72620]: INFO nova.compute.manager [req-1c43378b-93a0-44a5-8238-2abfba8c1b2d req-513eef0d-17f3-4206-94ab-7af721878309 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Neutron deleted interface cd69b166-e5ac-4331-bcab-883a3c008247; detaching it from the instance and deleting it from the info cache
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.network.neutron [req-1c43378b-93a0-44a5-8238-2abfba8c1b2d req-513eef0d-17f3-4206-94ab-7af721878309 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-1c43378b-93a0-44a5-8238-2abfba8c1b2d req-513eef0d-17f3-4206-94ab-7af721878309 service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Detach interface failed, port_id=cd69b166-e5ac-4331-bcab-883a3c008247, reason: Instance 9e585cc7-5953-49bd-9e66-8a789fc9866f could not be found. {{(pid=72620) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:16:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:28 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Deleted allocations for instance 9e585cc7-5953-49bd-9e66-8a789fc9866f
Aug 09 21:16:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-baf77fe1-1f82-4c0d-87b3-e0a567a91111 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] Acquiring lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] Lock "9e585cc7-5953-49bd-9e66-8a789fc9866f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] No waiting events found dispatching network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:29 user nova-compute[72620]: WARNING nova.compute.manager [req-0fbc7ac2-9b30-4f7b-8d0b-97e8a976daa5 req-f4f75989-575a-4fb8-8c96-b183761069de service nova] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Received unexpected event network-vif-plugged-cd69b166-e5ac-4331-bcab-883a3c008247 for instance with vm_state deleted and task_state None.
Aug 09 21:16:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:38 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615783.123365, c6da6bea-0a29-43df-8a37-85e118041827 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:16:38 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: c6da6bea-0a29-43df-8a37-85e118041827] VM Stopped (Lifecycle Event)
Aug 09 21:16:38 user nova-compute[72620]: DEBUG nova.compute.manager [None req-3b87a58c-32cf-43dd-b777-3204d83b3af5 None None] [instance: c6da6bea-0a29-43df-8a37-85e118041827] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:16:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:41 user nova-compute[72620]: INFO nova.compute.manager [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Unshelving
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_requests' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'numa_topology' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:16:42 user nova-compute[72620]: INFO nova.compute.claims [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Claim successful on node user
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:42 user nova-compute[72620]: INFO nova.network.neutron [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating port 0bb34cba-25e7-4380-96a3-60deec744efb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615787.3172483, 9e585cc7-5953-49bd-9e66-8a789fc9866f => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:16:42 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] VM Stopped (Lifecycle Event)
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-aea90de3-7ef1-4c91-bdb4-499033d931b4 None None] [instance: 9e585cc7-5953-49bd-9e66-8a789fc9866f] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.network.neutron [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG nova.compute.manager [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing instance network info cache due to event network-changed-0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:16:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG nova.network.neutron [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:16:43 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Creating image(s)
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG nova.network.neutron [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Refreshing network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "729e1b44ac49e0cd836a198e475892afc8812e01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "729e1b44ac49e0cd836a198e475892afc8812e01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.part --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.part --force-share --output=json" returned: 0 in 0.151s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG nova.virt.images [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb was qcow2, converting to raw {{(pid=72620) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG nova.privsep.utils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72620) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.part /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.converted {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated VIF entry in instance network info cache for port 0bb34cba-25e7-4380-96a3-60deec744efb. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG nova.network.neutron [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a581312b-a968-448f-8e70-a02675be3262 req-9aa76c10-49d2-49d2-91d7-dc257b8c7564 service nova] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:16:44 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.part /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.converted" returned: 0 in 0.443s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.converted --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01.converted --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "729e1b44ac49e0cd836a198e475892afc8812e01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.746s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "729e1b44ac49e0cd836a198e475892afc8812e01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "729e1b44ac49e0cd836a198e475892afc8812e01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01,backing_fmt=raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01,backing_fmt=raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk 1073741824" returned: 0 in 0.049s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "729e1b44ac49e0cd836a198e475892afc8812e01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01 --force-share --output=json" returned: 0 in 0.131s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'migration_context' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Rebasing disk image.
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d -F raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Verify base images {{(pid=72620) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Image id c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb yields fingerprint 729e1b44ac49e0cd836a198e475892afc8812e01 {{(pid=72620) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 21:16:45 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] image c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb at (/opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01): checking
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] image c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb at (/opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01): image is in use {{(pid=72620) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72620) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] 5384b00b-6425-4733-97a3-31724b4a1a2e is a valid instance name {{(pid=72620) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] 5384b00b-6425-4733-97a3-31724b4a1a2e has a disk file {{(pid=72620) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 09 21:16:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:16:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5384b00b-6425-4733-97a3-31724b4a1a2e is backed by 729e1b44ac49e0cd836a198e475892afc8812e01 {{(pid=72620) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5
Aug 09 21:16:46 user nova-compute[72620]: WARNING nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Active base files: /opt/stack/data/nova/instances/_base/729e1b44ac49e0cd836a198e475892afc8812e01
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Removable base files: /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648 /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5 /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97 /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12 /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5 /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/835ce913da3b6d543eabee8d414e4b7ec4ac230b
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/976c341de3f9a1fba54c7a7bee62eabfc528a648
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b0405b71e14a8aa2a5ffa8ead8daf56a7b486b5
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6dce56013317c7806e3d9924bf23fe7c0fb3ac97
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/195483999140cf25ca4da146ad7c2b60195b0adb
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/97064c5d7e46e55ffdbda19a62a71693e0dfdb12
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5c33bcfd73497a7b3b012b48507fb0ee18a2d92d
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/448db4caffadba574c2e790b019f18ad8f525fa5
Aug 09 21:16:46 user nova-compute[72620]: INFO nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d
Aug 09 21:16:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Verification complete {{(pid=72620) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 09 21:16:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Verify swap images {{(pid=72620) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 09 21:16:46 user nova-compute[72620]: DEBUG nova.virt.libvirt.imagecache [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Verify ephemeral images {{(pid=72620) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d -F raw /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk" returned: 0 in 2.108s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Ensure instance console log exists: /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start _get_guest_xml network_info=[{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c80cfceb47cf251a5aa00ac9b124033f',container_format='bare',created_at=2023-08-09T21:14:49Z,direct_url=<?>,disk_format='qcow2',id=c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-325470435-shelved',owner='75043330db1b414d8ad64a41a5bf7fc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T21:14:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:16:47 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:16:47 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c80cfceb47cf251a5aa00ac9b124033f',container_format='bare',created_at=2023-08-09T21:14:49Z,direct_url=<?>,disk_format='qcow2',id=c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-325470435-shelved',owner='75043330db1b414d8ad64a41a5bf7fc6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-09T21:14:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1369945133',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:14:53.032527',shelved_host='user',shelved_image_id='c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.objects.instance [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'pci_devices' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:16:47 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:16:47 user nova-compute[72620]:   <uuid>5384b00b-6425-4733-97a3-31724b4a1a2e</uuid>
Aug 09 21:16:47 user nova-compute[72620]:   <name>instance-0000002e</name>
Aug 09 21:16:47 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:16:47 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:16:47 user nova-compute[72620]:   <metadata>
Aug 09 21:16:47 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:16:47 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-325470435</nova:name>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:16:47</nova:creationTime>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:16:47 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:16:47 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:owner>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:user uuid="321c1c40fcf24714ad1c224351ff217e">tempest-AttachVolumeShelveTestJSON-1153095829-project-member</nova:user>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:project uuid="75043330db1b414d8ad64a41a5bf7fc6">tempest-AttachVolumeShelveTestJSON-1153095829</nova:project>
Aug 09 21:16:47 user nova-compute[72620]:       </nova:owner>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:root type="image" uuid="c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb"/>
Aug 09 21:16:47 user nova-compute[72620]:       <nova:ports>
Aug 09 21:16:47 user nova-compute[72620]:         <nova:port uuid="0bb34cba-25e7-4380-96a3-60deec744efb">
Aug 09 21:16:47 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 21:16:47 user nova-compute[72620]:         </nova:port>
Aug 09 21:16:47 user nova-compute[72620]:       </nova:ports>
Aug 09 21:16:47 user nova-compute[72620]:     </nova:instance>
Aug 09 21:16:47 user nova-compute[72620]:   </metadata>
Aug 09 21:16:47 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:16:47 user nova-compute[72620]:     <system>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="serial">5384b00b-6425-4733-97a3-31724b4a1a2e</entry>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="uuid">5384b00b-6425-4733-97a3-31724b4a1a2e</entry>
Aug 09 21:16:47 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:16:47 user nova-compute[72620]:     </system>
Aug 09 21:16:47 user nova-compute[72620]:   </sysinfo>
Aug 09 21:16:47 user nova-compute[72620]:   <os>
Aug 09 21:16:47 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:16:47 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:16:47 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:16:47 user nova-compute[72620]:   </os>
Aug 09 21:16:47 user nova-compute[72620]:   <features>
Aug 09 21:16:47 user nova-compute[72620]:     <acpi/>
Aug 09 21:16:47 user nova-compute[72620]:     <apic/>
Aug 09 21:16:47 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:16:47 user nova-compute[72620]:   </features>
Aug 09 21:16:47 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:16:47 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:16:47 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:16:47 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:16:47 user nova-compute[72620]:   </clock>
Aug 09 21:16:47 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:16:47 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:16:47 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:16:47 user nova-compute[72620]:   </cpu>
Aug 09 21:16:47 user nova-compute[72620]:   <devices>
Aug 09 21:16:47 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:16:47 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:16:47 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk"/>
Aug 09 21:16:47 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:16:47 user nova-compute[72620]:     </disk>
Aug 09 21:16:47 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:16:47 user nova-compute[72620]:       <mac address="fa:16:3e:7d:4c:ef"/>
Aug 09 21:16:47 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:16:47 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:16:47 user nova-compute[72620]:       <target dev="tap0bb34cba-25"/>
Aug 09 21:16:47 user nova-compute[72620]:     </interface>
Aug 09 21:16:47 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:16:47 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/console.log" append="off"/>
Aug 09 21:16:47 user nova-compute[72620]:     </serial>
Aug 09 21:16:47 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:16:47 user nova-compute[72620]:     <video>
Aug 09 21:16:47 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:16:47 user nova-compute[72620]:     </video>
Aug 09 21:16:47 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:16:47 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:16:47 user nova-compute[72620]:     </rng>
Aug 09 21:16:47 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:16:47 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:16:47 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:16:47 user nova-compute[72620]:     </memballoon>
Aug 09 21:16:47 user nova-compute[72620]:   </devices>
Aug 09 21:16:47 user nova-compute[72620]: </domain>
Aug 09 21:16:47 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1369945133',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member',shelved_at='2023-08-09T21:14:53.032527',shelved_host='user',shelved_image_id='c3514f3a-5d1a-4b4b-a1be-f09543b6a6fb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG os_vif [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb34cba-25, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bb34cba-25, col_values=(('external_ids', {'iface-id': '0bb34cba-25e7-4380-96a3-60deec744efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:4c:ef', 'vm-uuid': '5384b00b-6425-4733-97a3-31724b4a1a2e'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:48 user nova-compute[72620]: INFO os_vif [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25')
Aug 09 21:16:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:16:48 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] No VIF found with MAC fa:16:3e:7d:4c:ef, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:49 user nova-compute[72620]: WARNING nova.compute.manager [req-a8a65fee-7790-48dc-bf71-ef58b9f63b9c req-f764b0f7-43e2-4a4d-a8ea-2083546e438c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615811.420912, 5384b00b-6425-4733-97a3-31724b4a1a2e => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:16:51 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Resumed (Lifecycle Event)
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:16:51 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance spawned successfully.
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:16:51 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615811.4222782, 5384b00b-6425-4733-97a3-31724b4a1a2e => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:16:51 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Started (Lifecycle Event)
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:16:51 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:16:51 user nova-compute[72620]: WARNING nova.compute.manager [req-3c2ca530-aeb4-4ea0-8b74-0ce219436946 req-4be5e9d0-43d1-44ac-b58c-8f84c1d178c9 service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 09 21:16:51 user nova-compute[72620]: DEBUG nova.compute.manager [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:16:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-721f0a71-1cb1-4216-83bb-13a777d56868 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.973s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:16:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:16:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:17:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:17:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:17:20 user nova-compute[72620]: INFO nova.compute.claims [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Claim successful on node user
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:17:21 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.policy [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e8831d0d8fa4dd08c79611d77c6eae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4606478775694a338c2bc8d46ee3c4d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:17:21 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Creating image(s)
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "/opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk 1073741824" returned: 0 in 0.051s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.156s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Successfully created port: 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Cannot resize image /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.objects.instance [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'migration_context' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Ensure instance console log exists: /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Successfully updated port: 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquired lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-changed-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG nova.compute.manager [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Refreshing instance network info cache due to event network-changed-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] Acquiring lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:17:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating instance_info_cache with network_info: [{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Releasing lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Instance network_info: |[{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] Acquired lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.neutron [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Refreshing network info cache for port 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Start _get_guest_xml network_info=[{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:17:23 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:17:23 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1754663456',display_name='tempest-AttachVolumeNegativeTest-server-1754663456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1754663456',id=49,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISmxBBA7hKCZ4vw0AmyB4fOrjaE7h/nfTHmz7/BDb4HheJQ9q6YBa64/0whqbME5RpeZYU+fqAd/9BKjcR6j7KVk3IW5iOWD8cMJTHzRbMIeWfbLLNNEUBqHpjQT0LY+w==',key_name='tempest-keypair-1956695156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-rxxw450v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=2574aa00-a1eb-40fa-8269-24883111e0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.objects.instance [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:17:23 user nova-compute[72620]:   <uuid>2574aa00-a1eb-40fa-8269-24883111e0b0</uuid>
Aug 09 21:17:23 user nova-compute[72620]:   <name>instance-00000031</name>
Aug 09 21:17:23 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:17:23 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:17:23 user nova-compute[72620]:   <metadata>
Aug 09 21:17:23 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:17:23 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1754663456</nova:name>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:17:23</nova:creationTime>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:17:23 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:17:23 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:owner>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:user uuid="0e8831d0d8fa4dd08c79611d77c6eae8">tempest-AttachVolumeNegativeTest-1201906540-project-member</nova:user>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:project uuid="4606478775694a338c2bc8d46ee3c4d7">tempest-AttachVolumeNegativeTest-1201906540</nova:project>
Aug 09 21:17:23 user nova-compute[72620]:       </nova:owner>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:17:23 user nova-compute[72620]:       <nova:ports>
Aug 09 21:17:23 user nova-compute[72620]:         <nova:port uuid="6cd5bda0-034a-4ed1-84c0-a7fa133bacdd">
Aug 09 21:17:23 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 09 21:17:23 user nova-compute[72620]:         </nova:port>
Aug 09 21:17:23 user nova-compute[72620]:       </nova:ports>
Aug 09 21:17:23 user nova-compute[72620]:     </nova:instance>
Aug 09 21:17:23 user nova-compute[72620]:   </metadata>
Aug 09 21:17:23 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:17:23 user nova-compute[72620]:     <system>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="serial">2574aa00-a1eb-40fa-8269-24883111e0b0</entry>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="uuid">2574aa00-a1eb-40fa-8269-24883111e0b0</entry>
Aug 09 21:17:23 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:17:23 user nova-compute[72620]:     </system>
Aug 09 21:17:23 user nova-compute[72620]:   </sysinfo>
Aug 09 21:17:23 user nova-compute[72620]:   <os>
Aug 09 21:17:23 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:17:23 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:17:23 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:17:23 user nova-compute[72620]:   </os>
Aug 09 21:17:23 user nova-compute[72620]:   <features>
Aug 09 21:17:23 user nova-compute[72620]:     <acpi/>
Aug 09 21:17:23 user nova-compute[72620]:     <apic/>
Aug 09 21:17:23 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:17:23 user nova-compute[72620]:   </features>
Aug 09 21:17:23 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:17:23 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:17:23 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:17:23 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:17:23 user nova-compute[72620]:   </clock>
Aug 09 21:17:23 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:17:23 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:17:23 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:17:23 user nova-compute[72620]:   </cpu>
Aug 09 21:17:23 user nova-compute[72620]:   <devices>
Aug 09 21:17:23 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:17:23 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:17:23 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk"/>
Aug 09 21:17:23 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:17:23 user nova-compute[72620]:     </disk>
Aug 09 21:17:23 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:17:23 user nova-compute[72620]:       <mac address="fa:16:3e:7a:b7:9d"/>
Aug 09 21:17:23 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:17:23 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:17:23 user nova-compute[72620]:       <target dev="tap6cd5bda0-03"/>
Aug 09 21:17:23 user nova-compute[72620]:     </interface>
Aug 09 21:17:23 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:17:23 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/console.log" append="off"/>
Aug 09 21:17:23 user nova-compute[72620]:     </serial>
Aug 09 21:17:23 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:17:23 user nova-compute[72620]:     <video>
Aug 09 21:17:23 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:17:23 user nova-compute[72620]:     </video>
Aug 09 21:17:23 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:17:23 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:17:23 user nova-compute[72620]:     </rng>
Aug 09 21:17:23 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:17:23 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:17:23 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:17:23 user nova-compute[72620]:     </memballoon>
Aug 09 21:17:23 user nova-compute[72620]:   </devices>
Aug 09 21:17:23 user nova-compute[72620]: </domain>
Aug 09 21:17:23 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1754663456',display_name='tempest-AttachVolumeNegativeTest-server-1754663456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1754663456',id=49,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISmxBBA7hKCZ4vw0AmyB4fOrjaE7h/nfTHmz7/BDb4HheJQ9q6YBa64/0whqbME5RpeZYU+fqAd/9BKjcR6j7KVk3IW5iOWD8cMJTHzRbMIeWfbLLNNEUBqHpjQT0LY+w==',key_name='tempest-keypair-1956695156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-rxxw450v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=2574aa00-a1eb-40fa-8269-24883111e0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG os_vif [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cd5bda0-03, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cd5bda0-03, col_values=(('external_ids', {'iface-id': '6cd5bda0-034a-4ed1-84c0-a7fa133bacdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:b7:9d', 'vm-uuid': '2574aa00-a1eb-40fa-8269-24883111e0b0'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:23 user nova-compute[72620]: INFO os_vif [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03')
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:17:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:7a:b7:9d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:17:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updated VIF entry in instance network info cache for port 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:17:24 user nova-compute[72620]: DEBUG nova.network.neutron [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating instance_info_cache with network_info: [{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:17:24 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-dc67e4b3-7a86-4878-996a-9a2dbd5cd25f req-25ddfcf6-7f1c-46b8-bdec-d161bccb9d93 service nova] Releasing lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:17:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] No waiting events found dispatching network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:17:25 user nova-compute[72620]: WARNING nova.compute.manager [req-ff3ccc54-fa9b-4fd4-9f19-769611202d80 req-4ede6233-1a11-4b19-8838-1a3cdca89f5b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received unexpected event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd for instance with vm_state building and task_state spawning.
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:17:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615847.4855018, 2574aa00-a1eb-40fa-8269-24883111e0b0 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] VM Resumed (Lifecycle Event)
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] No waiting events found dispatching network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:17:27 user nova-compute[72620]: WARNING nova.compute.manager [req-1567c85d-1d35-41bf-8db0-1fb3d1155561 req-e366750f-f19c-4210-a6f0-069ae2bf5fac service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received unexpected event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd for instance with vm_state building and task_state spawning.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:17:27 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:17:27 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=25.198177337646484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Instance spawned successfully.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691615847.487624, 2574aa00-a1eb-40fa-8269-24883111e0b0 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] VM Started (Lifecycle Event)
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5384b00b-6425-4733-97a3-31724b4a1a2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2574aa00-a1eb-40fa-8269-24883111e0b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:17:27 user nova-compute[72620]: INFO nova.compute.manager [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Took 7.28 seconds to build instance.
Aug 09 21:17:27 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-017b92a1-ecbe-4939-8073-ec99ef99bd37 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.401s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:17:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:17:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:17:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:17:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:17:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:17:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:17:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:18:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [{"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-5384b00b-6425-4733-97a3-31724b4a1a2e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:18:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:18:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:28 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:18:28 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:18:28 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=25.175731658935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 5384b00b-6425-4733-97a3-31724b4a1a2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2574aa00-a1eb-40fa-8269-24883111e0b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:18:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:32 user nova-compute[72620]: INFO nova.compute.manager [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Terminating instance
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.compute.manager [req-81860dc4-fbb8-4340-8249-37d868b0597a req-55073d3b-5025-47c8-b059-b212d32c785b service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-unplugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:18:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Instance destroyed successfully.
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lazy-loading 'resources' on Instance uuid 5384b00b-6425-4733-97a3-31724b4a1a2e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-09T21:12:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325470435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325470435',id=46,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVkmrawaMOhndswjOP+RooUoZYZKBWmdm7X1o1OI4EHErzFap378cUiyyGyj3lYyN6A57MOHkrcKTpghzapNFCRCVAuAQ5PMBYCPcjKZkuFE6uW6br7T8RH1hROusi+Xw==',key_name='tempest-keypair-1369945133',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:16:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75043330db1b414d8ad64a41a5bf7fc6',ramdisk_id='',reservation_id='r-syfvq5yd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1153095829',owner_user_name='tempest-AttachVolumeShelveTestJSON-1153095829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='321c1c40fcf24714ad1c224351ff217e',uuid=5384b00b-6425-4733-97a3-31724b4a1a2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converting VIF {"id": "0bb34cba-25e7-4380-96a3-60deec744efb", "address": "fa:16:3e:7d:4c:ef", "network": {"id": "9ce47a30-e4e6-4944-8787-9f04a3ff4735", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837851344-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75043330db1b414d8ad64a41a5bf7fc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb34cba-25", "ovs_interfaceid": "0bb34cba-25e7-4380-96a3-60deec744efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG os_vif [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb34cba-25, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:32 user nova-compute[72620]: INFO os_vif [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:4c:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bb34cba-25e7-4380-96a3-60deec744efb,network=Network(9ce47a30-e4e6-4944-8787-9f04a3ff4735),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb34cba-25')
Aug 09 21:18:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Deleting instance files /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e_del
Aug 09 21:18:32 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Deletion of /opt/stack/data/nova/instances/5384b00b-6425-4733-97a3-31724b4a1a2e_del complete
Aug 09 21:18:32 user nova-compute[72620]: INFO nova.compute.manager [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 09 21:18:32 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:18:32 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:18:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:33 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:18:33 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Took 0.90 seconds to deallocate network for instance.
Aug 09 21:18:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-fb69e939-4edd-49f0-82ed-e13be3a8a510 req-4bf2694b-ddf8-4206-9cd0-b57c1f72c2bd service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-deleted-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:18:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:34 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Deleted allocations for instance 5384b00b-6425-4733-97a3-31724b4a1a2e
Aug 09 21:18:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-8af82bf5-9305-41fe-a390-90f0caa88e78 tempest-AttachVolumeShelveTestJSON-1153095829 tempest-AttachVolumeShelveTestJSON-1153095829-project-member] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] Acquiring lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] Lock "5384b00b-6425-4733-97a3-31724b4a1a2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:34 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] No waiting events found dispatching network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:18:34 user nova-compute[72620]: WARNING nova.compute.manager [req-4e2ee3a4-880e-43e9-bb4e-93679aa8dc15 req-a39faa51-24c5-4702-8159-ab415e60720c service nova] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Received unexpected event network-vif-plugged-0bb34cba-25e7-4380-96a3-60deec744efb for instance with vm_state deleted and task_state None.
Aug 09 21:18:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:18:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Triggering sync for uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 09 21:18:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:18:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:18:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:18:47 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691615912.8367157, 5384b00b-6425-4733-97a3-31724b4a1a2e => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:18:47 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] VM Stopped (Lifecycle Event)
Aug 09 21:18:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-7702aeba-d73b-4045-b571-c0fbe230ff5d None None] [instance: 5384b00b-6425-4733-97a3-31724b4a1a2e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:18:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:18:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:19:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-changed-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:19:11 user nova-compute[72620]: DEBUG nova.compute.manager [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Refreshing instance network info cache due to event network-changed-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:19:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] Acquiring lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:19:11 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] Acquired lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:19:11 user nova-compute[72620]: DEBUG nova.network.neutron [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Refreshing network info cache for port 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:19:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updated VIF entry in instance network info cache for port 6cd5bda0-034a-4ed1-84c0-a7fa133bacdd. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:19:12 user nova-compute[72620]: DEBUG nova.network.neutron [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating instance_info_cache with network_info: [{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:19:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-a98d888c-6226-45d7-a4eb-c03df6a1ec08 req-cd250f36-8e9a-4c33-bc44-9e2a620b454c service nova] Releasing lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:19:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:19:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:19:15 user nova-compute[72620]: INFO nova.compute.manager [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Attaching volume c2550d2d-ea8b-4d39-9012-e12a4c3867bf to /dev/vdb
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.utils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7068c22-54fd-4985-8969-bbd617ee557f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[504b42c9-978d-48d2-81d4-51c102f3132f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0f5e47-46ce-4d11-9ab2-00ee523205af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[71acde84-0a0b-4dbc-87a2-c66eae2caf38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:19:15 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:19:15 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d6967-1315-4b41-9e5b-fcafed289706]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG os_brick.utils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:19:15 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating existing volume attachment record: 7f92ab85-9137-4f7d-9ef6-29b4bd956755 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:19:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:19 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:19 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:19:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:19:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:19:19 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:19:20 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating instance_info_cache with network_info: [{"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:19:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-2574aa00-a1eb-40fa-8269-24883111e0b0" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:19:20 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:19:20 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:22 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCHAuyjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:19:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:19:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:19:23 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17b8814-08b4-4e2d-b0bc-d3faa07becc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:19:23 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0c6783-af1b-4355-afa2-2d780b23a3b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf] added
Aug 09 21:19:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0741af-0425-4c13-9b3b-a028fc8a84cd]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea24e76c-ddd4-4283-add2-8b9f3e98328a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCHAuyjV {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCHAuyjV" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e626c4-9925-414d-876e-3259877b6ade]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCHAuyjV'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c13c68-ee29-4db1-8a59-8dbbb90b1036]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2850704-3671-4cf7-aa46-298b8810a50e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:19:23 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:19:23 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:19:23 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:19:23 user nova-compute[72620]: 
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[80959614-53b5-4f63-ac13-28b904b155b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260]
Aug 09 21:19:23 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260] successful.
Aug 09 21:19:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c365a-6bcd-4852-a08d-f01e8186228a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5a583d-bb94-471f-964e-01ef0042a2d6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)
Aug 09 21:19:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)
Aug 09 21:19:23 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be1b73-1a2f-4a51-b590-3d4f38950c6a]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:23 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCHAuyjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26630323236336466', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630323236336466', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:19:24 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:19:25 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:19:25 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:19:25 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:19:25 user nova-compute[72620]:   <serial>c2550d2d-ea8b-4d39-9012-e12a4c3867bf</serial>
Aug 09 21:19:25 user nova-compute[72620]: </disk>
Aug 09 21:19:25 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] No VIF found with MAC fa:16:3e:7a:b7:9d, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d874b8e4-5cb7-4a7e-a1cb-c04776f4b650 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.859s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:19:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:19:26 user nova-compute[72620]: INFO nova.compute.manager [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Detaching volume c2550d2d-ea8b-4d39-9012-e12a4c3867bf
Aug 09 21:19:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:19:26 user nova-compute[72620]: INFO nova.virt.block_device [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Attempting to driver detach volume c2550d2d-ea8b-4d39-9012-e12a4c3867bf from mountpoint /dev/vdb
Aug 09 21:19:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Attempting to detach device vdb from instance 2574aa00-a1eb-40fa-8269-24883111e0b0 from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:19:26 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:19:26 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:19:26 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:19:26 user nova-compute[72620]:   <serial>c2550d2d-ea8b-4d39-9012-e12a4c3867bf</serial>
Aug 09 21:19:26 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:19:26 user nova-compute[72620]: </disk>
Aug 09 21:19:26 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:19:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance 2574aa00-a1eb-40fa-8269-24883111e0b0 from the persistent domain config.
Aug 09 21:19:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2574aa00-a1eb-40fa-8269-24883111e0b0 from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:19:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:19:26 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:19:26 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:19:26 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:19:26 user nova-compute[72620]:   <serial>c2550d2d-ea8b-4d39-9012-e12a4c3867bf</serial>
Aug 09 21:19:26 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:19:26 user nova-compute[72620]: </disk>
Aug 09 21:19:26 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691615967.3298593, 2574aa00-a1eb-40fa-8269-24883111e0b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:19:27 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully detached device vdb from instance 2574aa00-a1eb-40fa-8269-24883111e0b0 from the live domain config.
Aug 09 21:19:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCHAuyjV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:19:27 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a64d5-baf4-474c-bab9-9722ec0b7300]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d4003-d30d-4271-8511-ce20944ab71a]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)
Aug 09 21:19:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf (non-flash)
Aug 09 21:19:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30562950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e46dd7c-3f97-4860-b94f-8f43f5bbf7cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0920daef-62b8-4bd0-96d5-04be5dd150d2]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b73277-4a35-43e3-977d-e4f4b0244776]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f01e2-8517-4023-97b5-b676f7e5038a]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed9acec-0548-4a5a-9a30-5e1dd9c0ddf5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb97ef19-aaec-455a-9dcf-2a1f07939bfc]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260]
Aug 09 21:19:27 user nova-compute[72620]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf, portal: 172.16.0.220,3260] successful.
Aug 09 21:19:27 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2550d2d-ea8b-4d39-9012-e12a4c3867bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c729c-cd6f-48a0-bf6e-5c96e0283c97]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] <== disconnect_volume: return (264ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'flavor' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:19:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-9db3df69-1652-44b4-a1fa-171000097df1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.661s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:19:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:19:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:19:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:19:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=25.20236587524414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 2574aa00-a1eb-40fa-8269-24883111e0b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:19:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:19:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:19:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:17 user nova-compute[72620]: INFO nova.compute.manager [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Terminating instance
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.compute.manager [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-unplugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] No waiting events found dispatching network-vif-unplugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.compute.manager [req-8a94fe4d-3546-47ba-ab4c-bb1b5e6cc714 req-efdf293d-d9b4-420e-9a07-f9426a9aa2a9 service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-unplugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:20:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Instance destroyed successfully.
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lazy-loading 'resources' on Instance uuid 2574aa00-a1eb-40fa-8269-24883111e0b0 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:17:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1754663456',display_name='tempest-AttachVolumeNegativeTest-server-1754663456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1754663456',id=49,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISmxBBA7hKCZ4vw0AmyB4fOrjaE7h/nfTHmz7/BDb4HheJQ9q6YBa64/0whqbME5RpeZYU+fqAd/9BKjcR6j7KVk3IW5iOWD8cMJTHzRbMIeWfbLLNNEUBqHpjQT0LY+w==',key_name='tempest-keypair-1956695156',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:17:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4606478775694a338c2bc8d46ee3c4d7',ramdisk_id='',reservation_id='r-rxxw450v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1201906540',owner_user_name='tempest-AttachVolumeNegativeTest-1201906540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e8831d0d8fa4dd08c79611d77c6eae8',uuid=2574aa00-a1eb-40fa-8269-24883111e0b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converting VIF {"id": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "address": "fa:16:3e:7a:b7:9d", "network": {"id": "b92d6bb3-6982-460a-9f40-b37de896cb03", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1431683182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4606478775694a338c2bc8d46ee3c4d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cd5bda0-03", "ovs_interfaceid": "6cd5bda0-034a-4ed1-84c0-a7fa133bacdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG os_vif [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cd5bda0-03, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:17 user nova-compute[72620]: INFO os_vif [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:b7:9d,bridge_name='br-int',has_traffic_filtering=True,id=6cd5bda0-034a-4ed1-84c0-a7fa133bacdd,network=Network(b92d6bb3-6982-460a-9f40-b37de896cb03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cd5bda0-03')
Aug 09 21:20:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Deleting instance files /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0_del
Aug 09 21:20:17 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Deletion of /opt/stack/data/nova/instances/2574aa00-a1eb-40fa-8269-24883111e0b0_del complete
Aug 09 21:20:18 user nova-compute[72620]: INFO nova.compute.manager [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 09 21:20:18 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:20:18 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:20:18 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] Acquiring lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] No waiting events found dispatching network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:20:19 user nova-compute[72620]: WARNING nova.compute.manager [req-efa4433c-8c04-4362-aff1-0e7c4a6bf534 req-c4386e27-5e8d-40ca-9807-010b6df1790b service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received unexpected event network-vif-plugged-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd for instance with vm_state active and task_state deleting.
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:20:19 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Took 1.61 seconds to deallocate network for instance.
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-a01a6b53-4c6e-44a1-8745-4a1111499d44 req-d3c0801f-4d19-4b9f-9918-c63d8619c7eb service nova] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Received event network-vif-deleted-6cd5bda0-034a-4ed1-84c0-a7fa133bacdd {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:19 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Deleted allocations for instance 2574aa00-a1eb-40fa-8269-24883111e0b0
Aug 09 21:20:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-7b45e4a8-ff73-405a-a0a4-89cd1e84e7e1 tempest-AttachVolumeNegativeTest-1201906540 tempest-AttachVolumeNegativeTest-1201906540-project-member] Lock "2574aa00-a1eb-40fa-8269-24883111e0b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.788s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:20:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:20:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:20:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:20:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:30 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:20:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:20:31 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=25.219554901123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:20:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:20:32 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691616017.8969579, 2574aa00-a1eb-40fa-8269-24883111e0b0 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:20:32 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] VM Stopped (Lifecycle Event)
Aug 09 21:20:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-61d44bbf-90e3-4e07-a71b-8eae6da92e38 None None] [instance: 2574aa00-a1eb-40fa-8269-24883111e0b0] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:20:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:42 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:20:47 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:52 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:20:57 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:07 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:12 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:21 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:21:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:21:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:21:22 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:21:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:21:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:32 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:21:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8889MB free_disk=25.21718978881836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:21:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:43 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:21:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:21:58 user nova-compute[72620]: INFO nova.compute.claims [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Claim successful on node user
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:21:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:21:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Creating image(s)
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "/opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "/opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:58 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.policy [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6847e6e04c7e4b31b7bcb2060fde4ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c2ccef149941faab6fe7cb11677002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk 1073741824" returned: 0 in 0.049s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Cannot resize image /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lazy-loading 'migration_context' on Instance uuid f9aae203-9879-43f0-ab49-50afc1e45a87 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Ensure instance console log exists: /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:21:59 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Successfully created port: 05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:22:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Successfully updated port: 05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:22:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:22:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquired lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:22:00 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-changed-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.compute.manager [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Refreshing instance network info cache due to event network-changed-05005026-ca3a-4e74-bf6b-eae384ed1cea. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] Acquiring lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.neutron [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updating instance_info_cache with network_info: [{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Releasing lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Instance network_info: |[{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] Acquired lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Refreshing network info cache for port 05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Start _get_guest_xml network_info=[{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:22:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:22:01 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2032656366',display_name='tempest-VolumesNegativeTest-instance-2032656366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2032656366',id=50,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84c2ccef149941faab6fe7cb11677002',ramdisk_id='',reservation_id='r-g9ugie6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1079719814',owner_user_name='tempest-VolumesNegativeTest-1079719814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:21:59Z,user_data=None,user_id='6847e6e04c7e4b31b7bcb2060fde4ac1',uuid=f9aae203-9879-43f0-ab49-50afc1e45a87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converting VIF {"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.objects.instance [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lazy-loading 'pci_devices' on Instance uuid f9aae203-9879-43f0-ab49-50afc1e45a87 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:22:01 user nova-compute[72620]:   <uuid>f9aae203-9879-43f0-ab49-50afc1e45a87</uuid>
Aug 09 21:22:01 user nova-compute[72620]:   <name>instance-00000032</name>
Aug 09 21:22:01 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:22:01 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:22:01 user nova-compute[72620]:   <metadata>
Aug 09 21:22:01 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:22:01 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:name>tempest-VolumesNegativeTest-instance-2032656366</nova:name>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:22:01</nova:creationTime>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:22:01 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:22:01 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:owner>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:user uuid="6847e6e04c7e4b31b7bcb2060fde4ac1">tempest-VolumesNegativeTest-1079719814-project-member</nova:user>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:project uuid="84c2ccef149941faab6fe7cb11677002">tempest-VolumesNegativeTest-1079719814</nova:project>
Aug 09 21:22:01 user nova-compute[72620]:       </nova:owner>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:22:01 user nova-compute[72620]:       <nova:ports>
Aug 09 21:22:01 user nova-compute[72620]:         <nova:port uuid="05005026-ca3a-4e74-bf6b-eae384ed1cea">
Aug 09 21:22:01 user nova-compute[72620]:           <nova:ip type="fixed" address="192.168.233.40" ipVersion="4"/>
Aug 09 21:22:01 user nova-compute[72620]:         </nova:port>
Aug 09 21:22:01 user nova-compute[72620]:       </nova:ports>
Aug 09 21:22:01 user nova-compute[72620]:     </nova:instance>
Aug 09 21:22:01 user nova-compute[72620]:   </metadata>
Aug 09 21:22:01 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:22:01 user nova-compute[72620]:     <system>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="serial">f9aae203-9879-43f0-ab49-50afc1e45a87</entry>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="uuid">f9aae203-9879-43f0-ab49-50afc1e45a87</entry>
Aug 09 21:22:01 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:22:01 user nova-compute[72620]:     </system>
Aug 09 21:22:01 user nova-compute[72620]:   </sysinfo>
Aug 09 21:22:01 user nova-compute[72620]:   <os>
Aug 09 21:22:01 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:22:01 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:22:01 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:22:01 user nova-compute[72620]:   </os>
Aug 09 21:22:01 user nova-compute[72620]:   <features>
Aug 09 21:22:01 user nova-compute[72620]:     <acpi/>
Aug 09 21:22:01 user nova-compute[72620]:     <apic/>
Aug 09 21:22:01 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:22:01 user nova-compute[72620]:   </features>
Aug 09 21:22:01 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:22:01 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:22:01 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:22:01 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:22:01 user nova-compute[72620]:   </clock>
Aug 09 21:22:01 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:22:01 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:22:01 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:22:01 user nova-compute[72620]:   </cpu>
Aug 09 21:22:01 user nova-compute[72620]:   <devices>
Aug 09 21:22:01 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:22:01 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:22:01 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk"/>
Aug 09 21:22:01 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:22:01 user nova-compute[72620]:     </disk>
Aug 09 21:22:01 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:22:01 user nova-compute[72620]:       <mac address="fa:16:3e:b7:24:18"/>
Aug 09 21:22:01 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:22:01 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:22:01 user nova-compute[72620]:       <target dev="tap05005026-ca"/>
Aug 09 21:22:01 user nova-compute[72620]:     </interface>
Aug 09 21:22:01 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:22:01 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/console.log" append="off"/>
Aug 09 21:22:01 user nova-compute[72620]:     </serial>
Aug 09 21:22:01 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:22:01 user nova-compute[72620]:     <video>
Aug 09 21:22:01 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:22:01 user nova-compute[72620]:     </video>
Aug 09 21:22:01 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:22:01 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:22:01 user nova-compute[72620]:     </rng>
Aug 09 21:22:01 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:22:01 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:22:01 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:22:01 user nova-compute[72620]:     </memballoon>
Aug 09 21:22:01 user nova-compute[72620]:   </devices>
Aug 09 21:22:01 user nova-compute[72620]: </domain>
Aug 09 21:22:01 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2032656366',display_name='tempest-VolumesNegativeTest-instance-2032656366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2032656366',id=50,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84c2ccef149941faab6fe7cb11677002',ramdisk_id='',reservation_id='r-g9ugie6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1079719814',owner_user_name='tempest-VolumesNegativeTest-1079719814-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:21:59Z,user_data=None,user_id='6847e6e04c7e4b31b7bcb2060fde4ac1',uuid=f9aae203-9879-43f0-ab49-50afc1e45a87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converting VIF {"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG os_vif [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05005026-ca, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05005026-ca, col_values=(('external_ids', {'iface-id': '05005026-ca3a-4e74-bf6b-eae384ed1cea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:24:18', 'vm-uuid': 'f9aae203-9879-43f0-ab49-50afc1e45a87'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:01 user nova-compute[72620]: INFO os_vif [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca')
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] No VIF found with MAC fa:16:3e:b7:24:18, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updated VIF entry in instance network info cache for port 05005026-ca3a-4e74-bf6b-eae384ed1cea. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG nova.network.neutron [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updating instance_info_cache with network_info: [{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:22:01 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-248749c4-8ad5-4bfa-8eb9-cf0bf2b9112f req-fb1c6b0b-9e47-4b69-a755-85b3a0030a53 service nova] Releasing lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:22:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:02 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG nova.compute.manager [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] No waiting events found dispatching network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:22:03 user nova-compute[72620]: WARNING nova.compute.manager [req-601cfb93-c52d-403d-907b-69d8b497d99f req-3c07395a-86f3-43d9-ae82-474dcaf2d6de service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received unexpected event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea for instance with vm_state building and task_state spawning.
Aug 09 21:22:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616125.0341463, f9aae203-9879-43f0-ab49-50afc1e45a87 => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] VM Resumed (Lifecycle Event)
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Instance spawned successfully.
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616125.038867, f9aae203-9879-43f0-ab49-50afc1e45a87 => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] VM Started (Lifecycle Event)
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:22:05 user nova-compute[72620]: DEBUG nova.compute.manager [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] No waiting events found dispatching network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:22:05 user nova-compute[72620]: WARNING nova.compute.manager [req-44c4cd5b-a014-40c6-af07-507853aa5c1a req-1bed65ce-d787-4d5a-8c19-fb950b5479d8 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received unexpected event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea for instance with vm_state building and task_state spawning.
Aug 09 21:22:05 user nova-compute[72620]: INFO nova.compute.manager [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Took 6.65 seconds to build instance.
Aug 09 21:22:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-cd5114ed-4671-4269-a23c-1bd8bee5bbe5 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:22:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid f9aae203-9879-43f0-ab49-50afc1e45a87 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updating instance_info_cache with network_info: [{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:22:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:22:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:22:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:22:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.186370849609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f9aae203-9879-43f0-ab49-50afc1e45a87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:22:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:22:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:22:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:41 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:22:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:22:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:22:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:22:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:23:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:23:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:17 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:23 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:23:24 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid f9aae203-9879-43f0-ab49-50afc1e45a87 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updating instance_info_cache with network_info: [{"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-f9aae203-9879-43f0-ab49-50afc1e45a87" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:23:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:23:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:27 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:23:27 user nova-compute[72620]: INFO nova.compute.claims [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Claim successful on node user
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.policy [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bde8adfb2644eb698d953e217147d0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a52286350c3e4038b1f450b4c5f94ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:23:28 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Creating image(s)
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "/opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "/opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "/opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.132s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk 1073741824" returned: 0 in 0.049s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Successfully created port: f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Cannot resize image /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.objects.instance [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'migration_context' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Ensure instance console log exists: /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Successfully updated port: f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-changed-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG nova.compute.manager [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Refreshing instance network info cache due to event network-changed-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:23:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Instance network_info: |[{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Refreshing network info cache for port f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Start _get_guest_xml network_info=[{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:23:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:23:30 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-525911986',display_name='tempest-TestServerVolumeAttachmentScenario-server-525911986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-525911986',id=51,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfO4sCGtoHvevw3QUZ6lvyIRANECaH958a0PKCK4fwDiE5Pg4gpfVe49TZ+Hgz6P8+MWVR7yS3ZqSyt5wGf2wA8IL9iknostYt6clw+eXVNbdE7Y/vUX8ojHh/8E6nRgg==',key_name='tempest-keypair-2023027834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52286350c3e4038b1f450b4c5f94ad6',ramdisk_id='',reservation_id='r-01lypbr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-889292896',owner_user_name='tempest-TestServerVolumeAttachmentScenario-889292896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bde8adfb2644eb698d953e217147d0f',uuid=43ef1eeb-e5c6-4f77-8a4f-98574b2569ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converting VIF {"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'pci_devices' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:23:30 user nova-compute[72620]:   <uuid>43ef1eeb-e5c6-4f77-8a4f-98574b2569ba</uuid>
Aug 09 21:23:30 user nova-compute[72620]:   <name>instance-00000033</name>
Aug 09 21:23:30 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:23:30 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:23:30 user nova-compute[72620]:   <metadata>
Aug 09 21:23:30 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:23:30 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-525911986</nova:name>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:23:30</nova:creationTime>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:23:30 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:23:30 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:owner>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:user uuid="7bde8adfb2644eb698d953e217147d0f">tempest-TestServerVolumeAttachmentScenario-889292896-project-member</nova:user>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:project uuid="a52286350c3e4038b1f450b4c5f94ad6">tempest-TestServerVolumeAttachmentScenario-889292896</nova:project>
Aug 09 21:23:30 user nova-compute[72620]:       </nova:owner>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:23:30 user nova-compute[72620]:       <nova:ports>
Aug 09 21:23:30 user nova-compute[72620]:         <nova:port uuid="f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc">
Aug 09 21:23:30 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 09 21:23:30 user nova-compute[72620]:         </nova:port>
Aug 09 21:23:30 user nova-compute[72620]:       </nova:ports>
Aug 09 21:23:30 user nova-compute[72620]:     </nova:instance>
Aug 09 21:23:30 user nova-compute[72620]:   </metadata>
Aug 09 21:23:30 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:23:30 user nova-compute[72620]:     <system>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="serial">43ef1eeb-e5c6-4f77-8a4f-98574b2569ba</entry>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="uuid">43ef1eeb-e5c6-4f77-8a4f-98574b2569ba</entry>
Aug 09 21:23:30 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:23:30 user nova-compute[72620]:     </system>
Aug 09 21:23:30 user nova-compute[72620]:   </sysinfo>
Aug 09 21:23:30 user nova-compute[72620]:   <os>
Aug 09 21:23:30 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:23:30 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:23:30 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:23:30 user nova-compute[72620]:   </os>
Aug 09 21:23:30 user nova-compute[72620]:   <features>
Aug 09 21:23:30 user nova-compute[72620]:     <acpi/>
Aug 09 21:23:30 user nova-compute[72620]:     <apic/>
Aug 09 21:23:30 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:23:30 user nova-compute[72620]:   </features>
Aug 09 21:23:30 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:23:30 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:23:30 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:23:30 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:23:30 user nova-compute[72620]:   </clock>
Aug 09 21:23:30 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:23:30 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:23:30 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:23:30 user nova-compute[72620]:   </cpu>
Aug 09 21:23:30 user nova-compute[72620]:   <devices>
Aug 09 21:23:30 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:23:30 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:23:30 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk"/>
Aug 09 21:23:30 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:23:30 user nova-compute[72620]:     </disk>
Aug 09 21:23:30 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:23:30 user nova-compute[72620]:       <mac address="fa:16:3e:3c:79:11"/>
Aug 09 21:23:30 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:23:30 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:23:30 user nova-compute[72620]:       <target dev="tapf36eee9b-c4"/>
Aug 09 21:23:30 user nova-compute[72620]:     </interface>
Aug 09 21:23:30 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:23:30 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/console.log" append="off"/>
Aug 09 21:23:30 user nova-compute[72620]:     </serial>
Aug 09 21:23:30 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:23:30 user nova-compute[72620]:     <video>
Aug 09 21:23:30 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:23:30 user nova-compute[72620]:     </video>
Aug 09 21:23:30 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:23:30 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:23:30 user nova-compute[72620]:     </rng>
Aug 09 21:23:30 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:23:30 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:23:30 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:23:30 user nova-compute[72620]:     </memballoon>
Aug 09 21:23:30 user nova-compute[72620]:   </devices>
Aug 09 21:23:30 user nova-compute[72620]: </domain>
Aug 09 21:23:30 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-525911986',display_name='tempest-TestServerVolumeAttachmentScenario-server-525911986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-525911986',id=51,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfO4sCGtoHvevw3QUZ6lvyIRANECaH958a0PKCK4fwDiE5Pg4gpfVe49TZ+Hgz6P8+MWVR7yS3ZqSyt5wGf2wA8IL9iknostYt6clw+eXVNbdE7Y/vUX8ojHh/8E6nRgg==',key_name='tempest-keypair-2023027834',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a52286350c3e4038b1f450b4c5f94ad6',ramdisk_id='',reservation_id='r-01lypbr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-889292896',owner_user_name='tempest-TestServerVolumeAttachmentScenario-889292896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:23:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bde8adfb2644eb698d953e217147d0f',uuid=43ef1eeb-e5c6-4f77-8a4f-98574b2569ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converting VIF {"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG os_vif [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf36eee9b-c4, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf36eee9b-c4, col_values=(('external_ids', {'iface-id': 'f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:79:11', 'vm-uuid': '43ef1eeb-e5c6-4f77-8a4f-98574b2569ba'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:30 user nova-compute[72620]: INFO os_vif [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4')
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No VIF found with MAC fa:16:3e:3c:79:11, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updated VIF entry in instance network info cache for port f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG nova.network.neutron [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:23:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-62af06f3-a4e2-4a63-98e0-6fe0d9ab1026 req-1d486d01-1713-4972-985c-a1af5f1a4f38 service nova] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG nova.compute.manager [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] No waiting events found dispatching network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:23:31 user nova-compute[72620]: WARNING nova.compute.manager [req-16f98891-2d8e-4a06-bd9a-7471b21b1cc3 req-48f38dfe-4b0d-48e1-b726-03a31d1af1b4 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received unexpected event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc for instance with vm_state building and task_state spawning.
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:23:32 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616213.5907905, 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:23:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] VM Resumed (Lifecycle Event)
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] No waiting events found dispatching network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:23:33 user nova-compute[72620]: WARNING nova.compute.manager [req-16265ff3-680c-4614-932a-25c6ff670389 req-408e5e05-6b73-4cca-930e-a9c532aa718a service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received unexpected event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc for instance with vm_state building and task_state spawning.
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:23:33 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Instance spawned successfully.
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:23:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:23:33 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.17479705810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:23:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616213.5916545, 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:23:33 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] VM Started (Lifecycle Event)
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:23:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:23:34 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:23:34 user nova-compute[72620]: INFO nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:23:34 user nova-compute[72620]: INFO nova.compute.manager [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Took 6.27 seconds to build instance.
Aug 09 21:23:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-08194fae-668e-438a-bbb9-f8883a68e691 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance f9aae203-9879-43f0-ab49-50afc1e45a87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:23:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:23:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:48 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:48 user nova-compute[72620]: INFO nova.compute.manager [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Terminating instance
Aug 09 21:23:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-unplugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] No waiting events found dispatching network-vif-unplugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.compute.manager [req-e6a9308c-cdde-4064-9f29-1e6c4f8e2dbc req-8b9abab4-72c1-4ea3-9e11-723f8fb2438d service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-unplugged-05005026-ca3a-4e74-bf6b-eae384ed1cea for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:23:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Instance destroyed successfully.
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.objects.instance [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lazy-loading 'resources' on Instance uuid f9aae203-9879-43f0-ab49-50afc1e45a87 {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:21:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2032656366',display_name='tempest-VolumesNegativeTest-instance-2032656366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2032656366',id=50,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:22:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84c2ccef149941faab6fe7cb11677002',ramdisk_id='',reservation_id='r-g9ugie6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1079719814',owner_user_name='tempest-VolumesNegativeTest-1079719814-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:22:05Z,user_data=None,user_id='6847e6e04c7e4b31b7bcb2060fde4ac1',uuid=f9aae203-9879-43f0-ab49-50afc1e45a87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converting VIF {"id": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "address": "fa:16:3e:b7:24:18", "network": {"id": "7f495116-e557-4d67-8e64-c20c1032ce6f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2aaea29ed95d4cd4b7265a7c7d4d8f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05005026-ca", "ovs_interfaceid": "05005026-ca3a-4e74-bf6b-eae384ed1cea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG os_vif [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05005026-ca, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:23:49 user nova-compute[72620]: INFO os_vif [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:24:18,bridge_name='br-int',has_traffic_filtering=True,id=05005026-ca3a-4e74-bf6b-eae384ed1cea,network=Network(7f495116-e557-4d67-8e64-c20c1032ce6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05005026-ca')
Aug 09 21:23:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Deleting instance files /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87_del
Aug 09 21:23:49 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Deletion of /opt/stack/data/nova/instances/f9aae203-9879-43f0-ab49-50afc1e45a87_del complete
Aug 09 21:23:49 user nova-compute[72620]: INFO nova.compute.manager [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 09 21:23:49 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:23:49 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:23:50 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:23:50 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Took 0.54 seconds to deallocate network for instance.
Aug 09 21:23:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:50 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:23:50 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:23:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:50 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Deleted allocations for instance f9aae203-9879-43f0-ab49-50afc1e45a87
Aug 09 21:23:50 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-928600ed-9fda-4367-8aaa-fc64b20e6cb2 tempest-VolumesNegativeTest-1079719814 tempest-VolumesNegativeTest-1079719814-project-member] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.652s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] Acquiring lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:23:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:23:51 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] Lock "f9aae203-9879-43f0-ab49-50afc1e45a87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:23:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] No waiting events found dispatching network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:23:51 user nova-compute[72620]: WARNING nova.compute.manager [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received unexpected event network-vif-plugged-05005026-ca3a-4e74-bf6b-eae384ed1cea for instance with vm_state deleted and task_state None.
Aug 09 21:23:51 user nova-compute[72620]: DEBUG nova.compute.manager [req-5bf38460-4e98-4cca-9622-d1f6973b8a3b req-85a7c85d-7423-4546-83fe-4d2940802c44 service nova] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Received event network-vif-deleted-05005026-ca3a-4e74-bf6b-eae384ed1cea {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:23:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:23:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:04 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691616229.7056448, f9aae203-9879-43f0-ab49-50afc1e45a87 => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:24:04 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] VM Stopped (Lifecycle Event)
Aug 09 21:24:04 user nova-compute[72620]: DEBUG nova.compute.manager [None req-28e6326d-aad0-4a89-b7aa-fd3397dad289 None None] [instance: f9aae203-9879-43f0-ab49-50afc1e45a87] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:24:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:24:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:24 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:24:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:24:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:24:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:24:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:24:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:24:34 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:24:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:24:35 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.173954010009766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:24:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:24:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:24:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:24:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:24:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:25:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:25:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-changed-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.compute.manager [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Refreshing instance network info cache due to event network-changed-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.network.neutron [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Refreshing network info cache for port f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.network.neutron [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updated VIF entry in instance network info cache for port f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.network.neutron [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-375e1a15-2844-4b35-9de7-c1da6fb207fa req-8512c4ce-952b-43a0-8592-e2d5ef654e77 service nova] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:19 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:20 user nova-compute[72620]: INFO nova.compute.manager [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attaching volume 7e4f4a6f-5d14-4a8c-a296-761a27b2f615 to /dev/vdb
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.utils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db9ef7-20d3-4c4f-a64d-ad1705f70330]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[65684878-ae59-4328-8dc9-b25888127f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f84198-6b3d-447b-9baf-8a650f89514d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d21389-3024-4a6d-a7d1-4aee6c920ccf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:25:20 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:25:20 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab9aba-94c4-482c-a206-842231f127a5]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG os_brick.utils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:25:20 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating existing volume attachment record: 1806c824-b5e0-43bc-a0da-5d3d623d3ce9 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:25:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:25:25 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:25:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:25:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:25:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOaqfogW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:25:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:25:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:25:28 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff652da-cf77-4a8d-93fd-1199bcee41c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:25:28 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62224a5-79d4-4fc5-8d87-4578effed1fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615] added
Aug 09 21:25:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a488e079-5271-4e34-aed5-bf79f850e59c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b17390d-a2a7-47dd-a555-d1cdcbcf26e9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOaqfogW {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOaqfogW" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cadfc0-d60f-4bc1-b9a6-27c0a052df7d]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOaqfogW'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e214a5-8e8d-41f5-a811-efda8052b977]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f11272-810c-439a-810b-d84dab6d2633]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:25:28 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:25:28 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:25:28 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:25:28 user nova-compute[72620]: 
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c87aa-f10e-4dff-9c52-425753fc6fc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260]
Aug 09 21:25:28 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260] successful.
Aug 09 21:25:28 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:28 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a183250-8580-4bd7-912a-b97d5f98b5ee]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ff2a0-ac9e-4b09-bb5f-9b493f40a9e8]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:29 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7a02df-793e-4c29-a2a8-9cee956cf96f]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOaqfogW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:25:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23031356138393766', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031356138393766', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:25:30 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:25:30 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:25:30 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:25:30 user nova-compute[72620]:   <serial>7e4f4a6f-5d14-4a8c-a296-761a27b2f615</serial>
Aug 09 21:25:30 user nova-compute[72620]: </disk>
Aug 09 21:25:30 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No VIF found with MAC fa:16:3e:3c:79:11, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:25:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f9409c5c-3d3b-47df-b60d-123798dc1d00 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.304s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:33 user nova-compute[72620]: INFO nova.compute.manager [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attaching volume 391783cf-0393-4e29-af54-b2ea107dd227 to /dev/vdc
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.utils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87ac328-5a06-4c93-ab30-d2798518ad9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eae267-65ec-4c58-85c8-8fb803f40829]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6897485-e63e-4721-8ca8-afad30e477c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc067c06-1685-488c-95f1-f60e1c03f2c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:25:33 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:25:33 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e3dfa7-b3fc-4d2b-bda7-2a9eb7fc7fe0]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG os_brick.utils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:25:33 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating existing volume attachment record: 7381a8a1-7db1-4abb-9abb-6fa00dd1ff3a {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:25:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:25:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:25:36 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:25:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:25:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.17206573486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:25:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaqjAxrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:25:42 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:25:42 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:25:42 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb9428-3a1c-4245-b941-9c98c755ae83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:25:42 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d96a2-eda6-4c0c-aff7-8ea2d936a3bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227] added
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459979e-2172-4232-a3c2-02111de1f887]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b152661-49d3-414e-92f5-24df93a4c7c9]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaqjAxrm {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaqjAxrm" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b10ad-4c84-4401-996c-8f14ba0e430f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WaqjAxrm'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ef810-acb3-4236-a24b-748095cd10a0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ae9eec-ac6e-4de4-9a4c-bcce2ee5ee54]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[885e7a04-8334-4cb5-8a50-7c295b600bec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260]
Aug 09 21:25:42 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260] successful.
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad8377-a43f-4de4-a389-abc1d9834746]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014e4e3-be3b-4a85-8ace-8cb805d0196a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)
Aug 09 21:25:42 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ecf1ae-c06a-45b6-acc1-0f4e4cdc01fa]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:25:42 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaqjAxrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:25:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:25:43 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23965356563313133', 'path': '/dev/sdc'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:25:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965356563313133', 'path': '/dev/sdc'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:25:43 user nova-compute[72620]: DEBUG nova.objects.instance [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:43 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:25:43 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:25:43 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:25:43 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 21:25:43 user nova-compute[72620]:   <serial>391783cf-0393-4e29-af54-b2ea107dd227</serial>
Aug 09 21:25:43 user nova-compute[72620]: </disk>
Aug 09 21:25:43 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] No VIF found with MAC fa:16:3e:3c:79:11, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-3553bd3d-6f51-447d-9b5e-a455d4c73155 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.529s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:25:44 user nova-compute[72620]: INFO nova.compute.manager [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Detaching volume 391783cf-0393-4e29-af54-b2ea107dd227
Aug 09 21:25:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:44 user nova-compute[72620]: INFO nova.virt.block_device [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attempting to driver detach volume 391783cf-0393-4e29-af54-b2ea107dd227 from mountpoint /dev/vdc
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Attempting to detach device vdc from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:25:44 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:25:44 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:25:44 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 21:25:44 user nova-compute[72620]:   <serial>391783cf-0393-4e29-af54-b2ea107dd227</serial>
Aug 09 21:25:44 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 21:25:44 user nova-compute[72620]: </disk>
Aug 09 21:25:44 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:25:44 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully detached device vdc from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the persistent domain config.
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:25:44 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:25:44 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:25:44 user nova-compute[72620]:   <source dev="/dev/sdc"/>
Aug 09 21:25:44 user nova-compute[72620]:   <target dev="vdc" bus="virtio"/>
Aug 09 21:25:44 user nova-compute[72620]:   <serial>391783cf-0393-4e29-af54-b2ea107dd227</serial>
Aug 09 21:25:44 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 09 21:25:44 user nova-compute[72620]: </disk>
Aug 09 21:25:44 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616345.2361004, 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:25:45 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully detached device vdc from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the live domain config.
Aug 09 21:25:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaqjAxrm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:25:45 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c753b4-2ede-4f8d-8375-81dc6e4acc60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb1b836-7a71-4e32-98e9-305c28d31f8a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:45 user nova-compute[72620]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)
Aug 09 21:25:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:25:45 user nova-compute[72620]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 (non-flash)
Aug 09 21:25:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d20a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227'): ({'sdc'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Removing single pathed devices sdc {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64ea88-ca7b-4204-afa3-10c2bb41bef4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e2dbbf-c768-4ee0-b497-40a651f95343]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Flushing IO for device /dev/sdc {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9402536-a115-4a00-abb9-002c6ee3025e]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcd756c-c218-45e5-b27e-206e52e72b8f]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] SCSI volumes sdc have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[de67eb51-a15c-4d52-ad04-fa5603336b4f]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f220f1-24ab-49d5-862a-552c08fc54a6]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260]
Aug 09 21:25:45 user nova-compute[72620]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227, portal: 172.16.0.220,3260] successful.
Aug 09 21:25:45 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391783cf-0393-4e29-af54-b2ea107dd227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca0344-cc5d-48df-8643-fed017b70972]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== disconnect_volume: return (246ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:25:45 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:25:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:25:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-04177cf1-bea0-42e4-9c2e-f1e945659099 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.554s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:25:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:25:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:26:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:25 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:26:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:26:27 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [{"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:26:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:26:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:26:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:29 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:26:35 user nova-compute[72620]: INFO nova.compute.manager [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Detaching volume 7e4f4a6f-5d14-4a8c-a296-761a27b2f615
Aug 09 21:26:35 user nova-compute[72620]: INFO nova.virt.block_device [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Attempting to driver detach volume 7e4f4a6f-5d14-4a8c-a296-761a27b2f615 from mountpoint /dev/vdb
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Attempting to detach device vdb from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:26:35 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:26:35 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:26:35 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:26:35 user nova-compute[72620]:   <serial>7e4f4a6f-5d14-4a8c-a296-761a27b2f615</serial>
Aug 09 21:26:35 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:26:35 user nova-compute[72620]: </disk>
Aug 09 21:26:35 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:26:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully detached device vdb from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the persistent domain config.
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:26:35 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:26:35 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:26:35 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:26:35 user nova-compute[72620]:   <serial>7e4f4a6f-5d14-4a8c-a296-761a27b2f615</serial>
Aug 09 21:26:35 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:26:35 user nova-compute[72620]: </disk>
Aug 09 21:26:35 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616395.691209, 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:26:35 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully detached device vdb from instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba from the live domain config.
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOaqfogW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:26:35 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0b5848-f56e-45a5-9207-529e8863bf9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb423325-3655-4059-9165-00043e3cc0e1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:26:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 (non-flash)
Aug 09 21:26:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c304d3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95af992-fed2-4f7e-9c25-81eb107eca01]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c4baad-c55d-435b-84ae-5aaec29b54f2]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62710f0-df4d-4687-9658-21f8e117b6dc]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0efe24-b330-476e-a1a7-35bca842dd80]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0fdbbf-95d8-4a59-a649-04a9dbf7ff7b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eee295-3de4-4aa1-82fa-866c98820fa7]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260]
Aug 09 21:26:35 user nova-compute[72620]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615, portal: 172.16.0.220,3260] successful.
Aug 09 21:26:35 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e4f4a6f-5d14-4a8c-a296-761a27b2f615 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30037f-6e68-4707-8f84-870561d50454]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] <== disconnect_volume: return (248ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:26:35 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG nova.objects.instance [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'flavor' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-628dd380-8d60-4627-8c1e-05659034ddbf tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.565s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:26:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:26:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:26:37 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:26:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=25.171157836914062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:26:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:26:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:26:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:26:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:26:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:26:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:26:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:49 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:26:54 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:26:59 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:27:09 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:14 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:19 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:27:24 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:25 user nova-compute[72620]: INFO nova.compute.manager [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Terminating instance
Aug 09 21:27:25 user nova-compute[72620]: DEBUG nova.compute.manager [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-unplugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] No waiting events found dispatching network-vif-unplugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:27:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-aaff813b-99cc-4734-b438-0b6135cd78c4 req-0dfa1afb-a3cb-431a-947d-3674646be475 service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-unplugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Instance destroyed successfully.
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lazy-loading 'resources' on Instance uuid 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:23:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-525911986',display_name='tempest-TestServerVolumeAttachmentScenario-server-525911986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-525911986',id=51,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfO4sCGtoHvevw3QUZ6lvyIRANECaH958a0PKCK4fwDiE5Pg4gpfVe49TZ+Hgz6P8+MWVR7yS3ZqSyt5wGf2wA8IL9iknostYt6clw+eXVNbdE7Y/vUX8ojHh/8E6nRgg==',key_name='tempest-keypair-2023027834',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:23:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a52286350c3e4038b1f450b4c5f94ad6',ramdisk_id='',reservation_id='r-01lypbr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-889292896',owner_user_name='tempest-TestServerVolumeAttachmentScenario-889292896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:23:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bde8adfb2644eb698d953e217147d0f',uuid=43ef1eeb-e5c6-4f77-8a4f-98574b2569ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converting VIF {"id": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "address": "fa:16:3e:3c:79:11", "network": {"id": "85b54414-0f3e-4a09-830a-798464277495", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1497264606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a52286350c3e4038b1f450b4c5f94ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf36eee9b-c4", "ovs_interfaceid": "f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG os_vif [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf36eee9b-c4, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:27:26 user nova-compute[72620]: INFO os_vif [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:79:11,bridge_name='br-int',has_traffic_filtering=True,id=f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc,network=Network(85b54414-0f3e-4a09-830a-798464277495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf36eee9b-c4')
Aug 09 21:27:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Deleting instance files /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba_del
Aug 09 21:27:26 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Deletion of /opt/stack/data/nova/instances/43ef1eeb-e5c6-4f77-8a4f-98574b2569ba_del complete
Aug 09 21:27:26 user nova-compute[72620]: INFO nova.compute.manager [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 09 21:27:26 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Skipping network cache update for instance because it is being deleted. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 09 21:27:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:27:27 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Took 0.93 seconds to deallocate network for instance.
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:27 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Deleted allocations for instance 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-275a7c11-7fb7-4814-87ff-7d590d287677 tempest-TestServerVolumeAttachmentScenario-889292896 tempest-TestServerVolumeAttachmentScenario-889292896-project-member] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] Acquiring lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] Lock "43ef1eeb-e5c6-4f77-8a4f-98574b2569ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] No waiting events found dispatching network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:27:27 user nova-compute[72620]: WARNING nova.compute.manager [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received unexpected event network-vif-plugged-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc for instance with vm_state deleted and task_state None.
Aug 09 21:27:27 user nova-compute[72620]: DEBUG nova.compute.manager [req-990fd879-fcb4-4c28-971b-41866b7266cf req-9822c5b6-ec45-49e3-8eba-f87c193a968d service nova] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Received event network-vif-deleted-f36eee9b-c4a8-4fce-90a8-69a8fdcd97cc {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:27:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:27:38 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:27:38 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=25.198413848876953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:27:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:27:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:27:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:41 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691616446.3399272, 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:27:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] VM Stopped (Lifecycle Event)
Aug 09 21:27:41 user nova-compute[72620]: DEBUG nova.compute.manager [None req-376d6111-1466-414d-a49e-82f888d36f6c None None] [instance: 43ef1eeb-e5c6-4f77-8a4f-98574b2569ba] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:27:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:43 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:43 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:27:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:27:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:27:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:27:47 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:27:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:27:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:28:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:28:26 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:28:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:28:37 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:28:37 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:28:38 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:28:38 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.196964263916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:28:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:28:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:28:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:28:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:28:55 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:28:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:04 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:21 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:21 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Starting instance... {{(pid=72620) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72620) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 09 21:29:22 user nova-compute[72620]: INFO nova.compute.claims [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Claim successful on node user
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Start building networks asynchronously for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Allocating IP information in the background. {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] allocate_for_instance() {{(pid=72620) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 09 21:29:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Start building block device mappings for instance. {{(pid=72620) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.policy [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4bd5461818f4ad3b6a2e95e6e517d99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aa0a8be5e4046d39ace27d31bac920d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72620) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Start spawning the instance on the hypervisor. {{(pid=72620) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Creating instance directory {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 09 21:29:22 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Creating image(s)
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "/opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "/opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "/opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.163s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "2431e6782e7ebead85ed414e836c752d7276db4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:22 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk 1073741824 {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d,backing_fmt=raw /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk 1073741824" returned: 0 in 0.118s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "2431e6782e7ebead85ed414e836c752d7276db4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2431e6782e7ebead85ed414e836c752d7276db4d --force-share --output=json" returned: 0 in 0.202s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk. size=1073741824 {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.virt.disk.api [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Cannot resize image /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk to a smaller size. {{(pid=72620) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'migration_context' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Created local disks {{(pid=72620) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Ensure instance console log exists: /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/console.log {{(pid=72620) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:23 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Successfully created port: bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Successfully updated port: bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-changed-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.compute.manager [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Refreshing instance network info cache due to event network-changed-bad9968b-89d3-430d-bfc8-5472536e31c9. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Refreshing network info cache for port bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4e1d6f40-e2a5-4829-bc14-b582943ea5f7 req-866229d5-f87d-4d7f-ad3f-12b6b2d50533 service nova] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Building network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 09 21:29:25 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance cache missing network info. {{(pid=72620) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.network.neutron [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance network_info: |[{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72620) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Start _get_guest_xml network_info=[{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'guest_format': None, 'encryption_format': None, 'image_id': 'e5cbb687-0055-4eb1-92d5-736844e9b958'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 09 21:29:26 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:29:26 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CPU controller missing on host. {{(pid=72620) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.host [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CPU controller found on host. {{(pid=72620) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72620) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-09T20:37:03Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-09T20:37:38Z,direct_url=<?>,disk_format='qcow2',id=e5cbb687-0055-4eb1-92d5-736844e9b958,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2aaea29ed95d4cd4b7265a7c7d4d8f05',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-09T20:37:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flavor limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Image limits 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flavor pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Image pref 0:0:0 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72620) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Got 1 possible topologies {{(pid=72620) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.hardware [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72620) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1429553455',display_name='tempest-SnapshotDataIntegrityTests-server-1429553455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1429553455',id=52,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+GX+48juroGPnkEmXlOOCq7ykXakm7TWkkqJke4yNdYJcDvja8bkdMDdg03yD1bYCzRVVhbNhgpJu39+4mMQJn95gGp9vKd5qdnTF65sygW32QBR/QwRIN+IhEpcy/cw==',key_name='tempest-keypair-746717892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa0a8be5e4046d39ace27d31bac920d',ramdisk_id='',reservation_id='r-s6o4dk00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-535145560',owner_user_name='tempest-SnapshotDataIntegrityTests-535145560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd5461818f4ad3b6a2e95e6e517d99',uuid=53c63ea0-2151-4f46-9c10-b694bf1a866e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72620) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converting VIF {"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.objects.instance [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'pci_devices' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] End _get_guest_xml xml=<domain type="kvm">
Aug 09 21:29:26 user nova-compute[72620]:   <uuid>53c63ea0-2151-4f46-9c10-b694bf1a866e</uuid>
Aug 09 21:29:26 user nova-compute[72620]:   <name>instance-00000034</name>
Aug 09 21:29:26 user nova-compute[72620]:   <memory>524288</memory>
Aug 09 21:29:26 user nova-compute[72620]:   <vcpu>1</vcpu>
Aug 09 21:29:26 user nova-compute[72620]:   <metadata>
Aug 09 21:29:26 user nova-compute[72620]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 09 21:29:26 user nova-compute[72620]:       <nova:package version="0.0.0"/>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1429553455</nova:name>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:creationTime>2023-08-09 21:29:26</nova:creationTime>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:flavor name="m1.tiny">
Aug 09 21:29:26 user nova-compute[72620]:         <nova:memory>512</nova:memory>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:disk>1</nova:disk>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:swap>0</nova:swap>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:ephemeral>0</nova:ephemeral>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:vcpus>1</nova:vcpus>
Aug 09 21:29:26 user nova-compute[72620]:       </nova:flavor>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:owner>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:user uuid="b4bd5461818f4ad3b6a2e95e6e517d99">tempest-SnapshotDataIntegrityTests-535145560-project-member</nova:user>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:project uuid="8aa0a8be5e4046d39ace27d31bac920d">tempest-SnapshotDataIntegrityTests-535145560</nova:project>
Aug 09 21:29:26 user nova-compute[72620]:       </nova:owner>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:root type="image" uuid="e5cbb687-0055-4eb1-92d5-736844e9b958"/>
Aug 09 21:29:26 user nova-compute[72620]:       <nova:ports>
Aug 09 21:29:26 user nova-compute[72620]:         <nova:port uuid="bad9968b-89d3-430d-bfc8-5472536e31c9">
Aug 09 21:29:26 user nova-compute[72620]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 09 21:29:26 user nova-compute[72620]:         </nova:port>
Aug 09 21:29:26 user nova-compute[72620]:       </nova:ports>
Aug 09 21:29:26 user nova-compute[72620]:     </nova:instance>
Aug 09 21:29:26 user nova-compute[72620]:   </metadata>
Aug 09 21:29:26 user nova-compute[72620]:   <sysinfo type="smbios">
Aug 09 21:29:26 user nova-compute[72620]:     <system>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="product">OpenStack Nova</entry>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="version">0.0.0</entry>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="serial">53c63ea0-2151-4f46-9c10-b694bf1a866e</entry>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="uuid">53c63ea0-2151-4f46-9c10-b694bf1a866e</entry>
Aug 09 21:29:26 user nova-compute[72620]:       <entry name="family">Virtual Machine</entry>
Aug 09 21:29:26 user nova-compute[72620]:     </system>
Aug 09 21:29:26 user nova-compute[72620]:   </sysinfo>
Aug 09 21:29:26 user nova-compute[72620]:   <os>
Aug 09 21:29:26 user nova-compute[72620]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 09 21:29:26 user nova-compute[72620]:     <boot dev="hd"/>
Aug 09 21:29:26 user nova-compute[72620]:     <smbios mode="sysinfo"/>
Aug 09 21:29:26 user nova-compute[72620]:   </os>
Aug 09 21:29:26 user nova-compute[72620]:   <features>
Aug 09 21:29:26 user nova-compute[72620]:     <acpi/>
Aug 09 21:29:26 user nova-compute[72620]:     <apic/>
Aug 09 21:29:26 user nova-compute[72620]:     <vmcoreinfo/>
Aug 09 21:29:26 user nova-compute[72620]:   </features>
Aug 09 21:29:26 user nova-compute[72620]:   <clock offset="utc">
Aug 09 21:29:26 user nova-compute[72620]:     <timer name="pit" tickpolicy="delay"/>
Aug 09 21:29:26 user nova-compute[72620]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 09 21:29:26 user nova-compute[72620]:     <timer name="hpet" present="no"/>
Aug 09 21:29:26 user nova-compute[72620]:   </clock>
Aug 09 21:29:26 user nova-compute[72620]:   <cpu mode="custom" match="exact">
Aug 09 21:29:26 user nova-compute[72620]:     <model>Nehalem</model>
Aug 09 21:29:26 user nova-compute[72620]:     <topology sockets="1" cores="1" threads="1"/>
Aug 09 21:29:26 user nova-compute[72620]:   </cpu>
Aug 09 21:29:26 user nova-compute[72620]:   <devices>
Aug 09 21:29:26 user nova-compute[72620]:     <disk type="file" device="disk">
Aug 09 21:29:26 user nova-compute[72620]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 09 21:29:26 user nova-compute[72620]:       <source file="/opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk"/>
Aug 09 21:29:26 user nova-compute[72620]:       <target dev="vda" bus="virtio"/>
Aug 09 21:29:26 user nova-compute[72620]:     </disk>
Aug 09 21:29:26 user nova-compute[72620]:     <interface type="ethernet">
Aug 09 21:29:26 user nova-compute[72620]:       <mac address="fa:16:3e:83:02:42"/>
Aug 09 21:29:26 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:29:26 user nova-compute[72620]:       <mtu size="1442"/>
Aug 09 21:29:26 user nova-compute[72620]:       <target dev="tapbad9968b-89"/>
Aug 09 21:29:26 user nova-compute[72620]:     </interface>
Aug 09 21:29:26 user nova-compute[72620]:     <serial type="pty">
Aug 09 21:29:26 user nova-compute[72620]:       <log file="/opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/console.log" append="off"/>
Aug 09 21:29:26 user nova-compute[72620]:     </serial>
Aug 09 21:29:26 user nova-compute[72620]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 09 21:29:26 user nova-compute[72620]:     <video>
Aug 09 21:29:26 user nova-compute[72620]:       <model type="virtio"/>
Aug 09 21:29:26 user nova-compute[72620]:     </video>
Aug 09 21:29:26 user nova-compute[72620]:     <rng model="virtio">
Aug 09 21:29:26 user nova-compute[72620]:       <backend model="random">/dev/urandom</backend>
Aug 09 21:29:26 user nova-compute[72620]:     </rng>
Aug 09 21:29:26 user nova-compute[72620]:     <controller type="usb" index="0" model="none"/>
Aug 09 21:29:26 user nova-compute[72620]:     <memballoon model="virtio">
Aug 09 21:29:26 user nova-compute[72620]:       <stats period="10"/>
Aug 09 21:29:26 user nova-compute[72620]:     </memballoon>
Aug 09 21:29:26 user nova-compute[72620]:   </devices>
Aug 09 21:29:26 user nova-compute[72620]: </domain>
Aug 09 21:29:26 user nova-compute[72620]:  {{(pid=72620) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1429553455',display_name='tempest-SnapshotDataIntegrityTests-server-1429553455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1429553455',id=52,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+GX+48juroGPnkEmXlOOCq7ykXakm7TWkkqJke4yNdYJcDvja8bkdMDdg03yD1bYCzRVVhbNhgpJu39+4mMQJn95gGp9vKd5qdnTF65sygW32QBR/QwRIN+IhEpcy/cw==',key_name='tempest-keypair-746717892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8aa0a8be5e4046d39ace27d31bac920d',ramdisk_id='',reservation_id='r-s6o4dk00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-535145560',owner_user_name='tempest-SnapshotDataIntegrityTests-535145560-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-09T21:29:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd5461818f4ad3b6a2e95e6e517d99',uuid=53c63ea0-2151-4f46-9c10-b694bf1a866e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converting VIF {"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG os_vif [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89') {{(pid=72620) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad9968b-89, may_exist=True, interface_attrs={}) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbad9968b-89, col_values=(('external_ids', {'iface-id': 'bad9968b-89d3-430d-bfc8-5472536e31c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:02:42', 'vm-uuid': '53c63ea0-2151-4f46-9c10-b694bf1a866e'}),), if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:26 user nova-compute[72620]: INFO os_vif [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89')
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:29:26 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No VIF found with MAC fa:16:3e:83:02:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Skipping network cache update for instance because it is Building. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:27 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG nova.compute.manager [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] No waiting events found dispatching network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:29:28 user nova-compute[72620]: WARNING nova.compute.manager [req-74076c87-cb7f-444a-8d08-3f397d40dff3 req-a84b1e57-bd2c-43db-91e6-7d438f634a93 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received unexpected event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 for instance with vm_state building and task_state spawning.
Aug 09 21:29:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] No waiting events found dispatching network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:29:30 user nova-compute[72620]: WARNING nova.compute.manager [req-ba50019a-5fdc-409a-8ac6-ad0f74b7a025 req-2350c087-3d6b-475b-be51-0e061c5ea3c8 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received unexpected event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 for instance with vm_state building and task_state spawning.
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616570.7090337, 53c63ea0-2151-4f46-9c10-b694bf1a866e => Resumed> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] VM Resumed (Lifecycle Event)
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance event wait completed in 0 seconds for  {{(pid=72620) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Guest created on hypervisor {{(pid=72620) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance spawned successfully.
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_cdrom_bus of ide {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_disk_bus of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_input_bus of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_pointer_model of None {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_video_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Found default for hw_vif_model of virtio {{(pid=72620) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.virt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Emitting event <LifecycleEvent: 1691616570.7105684, 53c63ea0-2151-4f46-9c10-b694bf1a866e => Started> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] VM Started (Lifecycle Event)
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72620) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.compute.manager [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 09 21:29:30 user nova-compute[72620]: INFO nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Took 8.30 seconds to spawn the instance on the hypervisor.
Aug 09 21:29:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:29:31 user nova-compute[72620]: INFO nova.compute.manager [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Took 9.01 seconds to build instance.
Aug 09 21:29:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-d1383615-4627-40eb-a562-c81a8650f345 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:29:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:29:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:29:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8454MB free_disk=25.18173599243164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:29:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:29:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:29:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:29:44 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:29:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:28 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:30:29 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:30:30 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:30:30 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:30:30 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:30:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:30:38 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:30:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:30:39 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8735MB free_disk=25.151142120361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:30:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:30:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:30:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:30:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:30:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:30:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-changed-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG nova.compute.manager [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Refreshing instance network info cache due to event network-changed-bad9968b-89d3-430d-bfc8-5472536e31c9. {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:31:13 user nova-compute[72620]: DEBUG nova.network.neutron [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Refreshing network info cache for port bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 09 21:31:14 user nova-compute[72620]: DEBUG nova.network.neutron [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated VIF entry in instance network info cache for port bad9968b-89d3-430d-bfc8-5472536e31c9. {{(pid=72620) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 09 21:31:14 user nova-compute[72620]: DEBUG nova.network.neutron [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:31:14 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-49aeb772-3eaf-4a55-9174-656c95aea3af req-414e2246-ff6a-4350-a06f-f83bb3aad971 service nova] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:31:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:31:17 user nova-compute[72620]: INFO nova.compute.manager [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attaching volume 87fb0072-3048-4d51-b5be-5c6ce191d8e3 to /dev/vdb
Aug 09 21:31:17 user nova-compute[72620]: DEBUG os_brick.utils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[847bd966-5882-42b7-83f6-501f59fceecb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3666f03c-0f72-49e5-bd88-2b550f51218b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e95767-7812-426f-b894-91d3da415a36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e327bb-0a15-48d5-83bc-e7c769161a09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:17 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:31:18 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:31:18 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7a5e4-56f8-44e0-b602-3d8aad38682f]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG os_brick.utils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating existing volume attachment record: cd11ede9-244a-48df-99cc-581625e5ca27 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:31:18 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:23 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylokPZwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:31:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:31:25 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:31:25 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9dade1-9d12-46dc-a57f-e96d5c361cd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:31:25 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c69368-b7ae-4c96-8c95-36bedd324dff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3] added
Aug 09 21:31:25 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:25 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af4a498-ffcf-4a9a-bd11-9c351cf53eeb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6e80d3-f3b9-4dab-9cc2-c7d3c9d1cc8a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylokPZwV {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ylokPZwV" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9186ef1-8bbe-4c9b-87dd-5432134b113b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ylokPZwV'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a972c-551f-46f8-b0c8-aebb6f93ee3b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d065c61d-253a-4613-be21-678817b45aef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:31:26 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:31:26 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:31:26 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:31:26 user nova-compute[72620]: 
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[44388840-0aad-4e83-a753-8e760e71f831]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260]
Aug 09 21:31:26 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260] successful.
Aug 09 21:31:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3ac1b4-7f14-421f-a735-22cbe1df03ba]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[07197006-ed30-4f89-bf57-8f616b2c8bbc]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)
Aug 09 21:31:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)
Aug 09 21:31:26 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b957d7f-ef62-4482-bdeb-32f64d70ac79]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylokPZwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:31:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23562666436303437', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562666436303437', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.objects.instance [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:31:27 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:31:27 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:31:27 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:31:27 user nova-compute[72620]:   <serial>87fb0072-3048-4d51-b5be-5c6ce191d8e3</serial>
Aug 09 21:31:27 user nova-compute[72620]: </disk>
Aug 09 21:31:27 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No VIF found with MAC fa:16:3e:83:02:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:31:27 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-f815e9a8-d4f7-47fc-96bd-861b293ebb17 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.919s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:31:28 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:30 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:31:31 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:31:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:31:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:31:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:31:33 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:38 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:39 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:31:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72620) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:31:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.149871826171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:31:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:31:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:31:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:31:52 user nova-compute[72620]: INFO nova.compute.manager [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Detaching volume 87fb0072-3048-4d51-b5be-5c6ce191d8e3
Aug 09 21:31:52 user nova-compute[72620]: INFO nova.virt.block_device [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attempting to driver detach volume 87fb0072-3048-4d51-b5be-5c6ce191d8e3 from mountpoint /dev/vdb
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Attempting to detach device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:31:52 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:31:52 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:31:52 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:31:52 user nova-compute[72620]:   <serial>87fb0072-3048-4d51-b5be-5c6ce191d8e3</serial>
Aug 09 21:31:52 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:31:52 user nova-compute[72620]: </disk>
Aug 09 21:31:52 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:31:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config.
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:31:52 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:31:52 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:31:52 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:31:52 user nova-compute[72620]:   <serial>87fb0072-3048-4d51-b5be-5c6ce191d8e3</serial>
Aug 09 21:31:52 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:31:52 user nova-compute[72620]: </disk>
Aug 09 21:31:52 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616712.7270317, 53c63ea0-2151-4f46-9c10-b694bf1a866e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:31:52 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config.
Aug 09 21:31:52 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ylokPZwV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:31:52 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c82d12-0bc9-4872-a820-14f90042f831]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[02128a50-7cf2-4ee2-aa24-eaf8daef2502]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)
Aug 09 21:31:52 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 (non-flash)
Aug 09 21:31:52 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c50238c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[290887e6-b4ab-4c94-b1e0-71a9bc1a40cb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c56cae-06e6-474d-b10f-357efa32b051]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150c584-f297-4650-b40d-f4695b068a0a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ea0e3b-e0af-4811-b45c-db85f5e1898f]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b50965-3052-4d50-b038-06cd9e9f699c]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba7523-6f23-4881-aea8-0864bd49aa3f]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260]
Aug 09 21:31:52 user nova-compute[72620]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3, portal: 172.16.0.220,3260] successful.
Aug 09 21:31:52 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:52 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87fb0072-3048-4d51-b5be-5c6ce191d8e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d3e42-ca60-4aba-97bd-db2ab1e21927]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== disconnect_volume: return (261ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG nova.objects.instance [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:31:53 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-fabcba72-1b61-4949-8d18-dbe05c58f1ef tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.571s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:31:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:32:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:32:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:32:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:32:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:32:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:32:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:32:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:32:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8779MB free_disk=25.141246795654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:32:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:32:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:42 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:32:43 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:32:46 user nova-compute[72620]: INFO nova.compute.manager [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attaching volume 1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 to /dev/vdb
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.utils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5af9af-078f-4dff-801d-ba5c432deb67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebebe8b-f792-4c3b-a861-709524e645d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f53ea1-3342-49ee-895f-e597c2f37e97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d832a-da57-46f7-99e4-9603cc9b76ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:32:46 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:32:46 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95e799-7621-490c-9f27-71f775d3ff19]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG os_brick.utils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating existing volume attachment record: b33d062b-a25f-4145-854f-c95ca1f68d33 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:32:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:48 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:50 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:53 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:53 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72620) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbzGemco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:32:54 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:32:54 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:32:54 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de85830-df90-4894-aa65-af8aed8d9e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:32:54 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e0e60-7960-47d3-86b3-6377af918f56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8] added
Aug 09 21:32:54 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e27b9e-4033-4d92-abd7-664a071a5b20]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[479a07e1-428f-4f8e-a7f6-6ed7695582c0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbzGemco {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbzGemco" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[58711c1e-f482-41ae-a758-a67f74cd1e56]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fbzGemco'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bfce55-7bbd-4696-9e24-cb25937d0ae0]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab09c8a-f697-46aa-a4a7-6b4e96ab9d5d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:32:54 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:32:54 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:32:54 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:32:54 user nova-compute[72620]: 
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec89a0b-248b-44ba-9097-62150d444db6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260]
Aug 09 21:32:54 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260] successful.
Aug 09 21:32:54 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37255964-082a-4e39-8d1d-c8ec32ad2bca]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ffa5b-8f78-48ea-bdce-948fd5881170]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)
Aug 09 21:32:54 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)
Aug 09 21:32:54 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb50ee3-3fc5-4e87-8dfe-cc558a5df9f6]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:54 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbzGemco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23031383636643461', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031383636643461', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:32:55 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:32:55 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:32:55 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:32:55 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:32:55 user nova-compute[72620]:   <serial>1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8</serial>
Aug 09 21:32:55 user nova-compute[72620]: </disk>
Aug 09 21:32:55 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:32:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:32:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:32:56 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No VIF found with MAC fa:16:3e:83:02:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:32:56 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ec3b7ef9-3e66-4c3f-987d-e2db79665f85 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.886s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:32:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:32:58 user nova-compute[72620]: INFO nova.compute.manager [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Detaching volume 1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8
Aug 09 21:32:58 user nova-compute[72620]: INFO nova.virt.block_device [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attempting to driver detach volume 1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 from mountpoint /dev/vdb
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Attempting to detach device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:32:58 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:32:58 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:32:58 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:32:58 user nova-compute[72620]:   <serial>1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8</serial>
Aug 09 21:32:58 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:32:58 user nova-compute[72620]: </disk>
Aug 09 21:32:58 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:32:58 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config.
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:32:58 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:32:58 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:32:58 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:32:58 user nova-compute[72620]:   <serial>1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8</serial>
Aug 09 21:32:58 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:32:58 user nova-compute[72620]: </disk>
Aug 09 21:32:58 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:32:58 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616779.3597, 53c63ea0-2151-4f46-9c10-b694bf1a866e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:32:59 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config.
Aug 09 21:32:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbzGemco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:32:59 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3e318-3909-4a96-9ae0-773b04fb55b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf62f3-4ed2-4713-8b72-fe6a7a341286]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)
Aug 09 21:32:59 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 (non-flash)
Aug 09 21:32:59 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c6d29a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a668f7-3297-4574-a4d7-50bbbb5fad13]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.062s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e2ba0-24db-41ee-acf0-96a38d9d88f5]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a6abb7-453f-4ea5-9c01-f190e37dc2ab]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb5d3a-8706-47fc-8b87-851f449aabaf]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa222784-2a2c-472c-844b-ed3a8c185dcb]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391efe4-5476-464b-9122-77dba2551369]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260]
Aug 09 21:32:59 user nova-compute[72620]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8, portal: 172.16.0.220,3260] successful.
Aug 09 21:32:59 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ce87cbe-394a-4d96-a08d-80a7cd6e5dc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f171a0c-2876-4e4a-b80f-ec03417931c1]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== disconnect_volume: return (318ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:32:59 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:33:00 user nova-compute[72620]: DEBUG nova.objects.instance [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:33:00 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-1c0a6166-c500-44e5-bd5a-267c6025f761 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:33:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:33:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:33:32 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:33:33 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:33:33 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:33:33 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:33:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:33:40 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:33:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:33:41 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:33:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=25.1402587890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:33:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing inventories for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating ProviderTree inventory for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Updating inventory in ProviderTree for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing aggregate associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, aggregates: None {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Refreshing trait associations for resource provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_NODE,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE41,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS {{(pid=72620) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:33:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:33:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:44 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:33:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:33:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:33:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG nova.objects.instance [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:33:52 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:33:52 user nova-compute[72620]: INFO nova.compute.manager [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attaching volume e8559374-5c3d-4791-8451-b6e5cdce13ac to /dev/vdb
Aug 09 21:33:52 user nova-compute[72620]: DEBUG os_brick.utils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cdb49b-02e9-4801-b4cd-c4b9312104d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c817cba-8673-404a-bf4f-a4c274ba7013]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[17189432-aba8-49ff-b2c4-a37206c5b510]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c9d9f-a08e-4109-93a0-f0b585700245]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:33:53 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:33:53 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c899574a-06b0-448b-9406-ba7bc8984c8b]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG os_brick.utils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating existing volume attachment record: 2eae6c30-d54c-4cbf-90a5-2030d1b67682 {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:33:53 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:33:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXsihxlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:34:01 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:34:01 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:34:01 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[880cc3d0-5a51-49af-873c-4b272cbea7dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:34:01 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ae8d7-c36b-4e6d-9b41-7fafe791b338]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac] added
Aug 09 21:34:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1fa0d-c19b-40be-bb93-16c993641810]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[37765b82-6135-4379-a9a3-3934d1119552]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXsihxlG {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXsihxlG" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4dc78-e465-4dea-b0a9-fbae3caebb46]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXsihxlG'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77248df-2a85-4c09-b9bc-d829b94907de]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ccdbb3-5416-4328-9277-7b277a58ec11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:34:01 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:34:01 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:34:01 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:34:01 user nova-compute[72620]: 
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d1ce3-4d97-43d5-92b9-a97b0f22f5b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260]
Aug 09 21:34:01 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260] successful.
Aug 09 21:34:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aca668-a5a5-406b-8d74-420d01feda1b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[076f4f2c-4317-4e73-ba32-77a694542df0]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)
Aug 09 21:34:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)
Aug 09 21:34:01 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a4612-3e12-46ae-a02c-496904861cae]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXsihxlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:34:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23763623761333330', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623761333330', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.objects.instance [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:34:02 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:34:02 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:34:02 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:34:02 user nova-compute[72620]:   <serial>e8559374-5c3d-4791-8451-b6e5cdce13ac</serial>
Aug 09 21:34:02 user nova-compute[72620]: </disk>
Aug 09 21:34:02 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No VIF found with MAC fa:16:3e:83:02:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:34:02 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-50a5b065-13d4-4b8c-8196-001510099cb7 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.945s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:34:05 user nova-compute[72620]: INFO nova.compute.manager [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Detaching volume e8559374-5c3d-4791-8451-b6e5cdce13ac
Aug 09 21:34:05 user nova-compute[72620]: INFO nova.virt.block_device [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attempting to driver detach volume e8559374-5c3d-4791-8451-b6e5cdce13ac from mountpoint /dev/vdb
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Attempting to detach device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:34:05 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:34:05 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:34:05 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:34:05 user nova-compute[72620]:   <serial>e8559374-5c3d-4791-8451-b6e5cdce13ac</serial>
Aug 09 21:34:05 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:34:05 user nova-compute[72620]: </disk>
Aug 09 21:34:05 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:34:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config.
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:34:05 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:34:05 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:34:05 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:34:05 user nova-compute[72620]:   <serial>e8559374-5c3d-4791-8451-b6e5cdce13ac</serial>
Aug 09 21:34:05 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:34:05 user nova-compute[72620]: </disk>
Aug 09 21:34:05 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616845.8656766, 53c63ea0-2151-4f46-9c10-b694bf1a866e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:34:05 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config.
Aug 09 21:34:05 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXsihxlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:34:05 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f21f69-c05f-4339-92f9-321859b25fd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b5c655-4fed-4070-9dbb-d96c424465aa]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)
Aug 09 21:34:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac (non-flash)
Aug 09 21:34:05 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c30308700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b5573-7dda-4206-8422-4a90c55d806f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5079b1-073f-45c7-8c81-1120d633c610]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f56c6d-ffb4-41ad-9fe0-a66b49225479]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:34:05 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83f9e6-ed41-4d4c-856a-990fba96f963]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7f645d-54ef-42cd-b93c-db13c770afa3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5818a63-b856-4c40-a13c-7249afa4b62c]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260]
Aug 09 21:34:06 user nova-compute[72620]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac, portal: 172.16.0.220,3260] successful.
Aug 09 21:34:06 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8559374-5c3d-4791-8451-b6e5cdce13ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a568a-e3ac-4879-92a8-9ba75fa6a9f5]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== disconnect_volume: return (274ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG nova.objects.instance [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:34:06 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-ce00de24-2f1f-4e04-9830-8e1a3b35fe9e tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:34:08 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:34:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:32 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:34 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:34:34 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:34:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:37 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:34:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:43 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:34:43 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.13930892944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:34:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:34:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:34:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:34:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:34:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG nova.objects.instance [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:34:59 user nova-compute[72620]: INFO nova.compute.manager [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attaching volume b270a092-7667-474b-9127-c95f073b9383 to /dev/vdb
Aug 09 21:34:59 user nova-compute[72620]: DEBUG os_brick.utils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a40c2b-cb12-4305-bbe0-abd00f27c305]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fe9596336f5\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ec721-6f92-4750-8933-3e40b3d76296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f002e2c-f8ac-46d8-b8c8-8c8dc23af577]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc18e503-a38a-4b5e-ab0c-7f321e669527]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Running cmd (subprocess): nvme version {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] 'nvme version' failed. Not Retrying. {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] nvme not present on system {{(pid=72620) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 09 21:34:59 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 09 21:35:00 user nova-compute[72620]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 09 21:35:00 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9d8ae-d2aa-4c23-8e61-cb8daf637e75]: (4, '') {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72620) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.lightos [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] LIGHTOS: no hostnqn found. {{(pid=72620) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG os_brick.utils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fe9596336f5', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:35:00 user nova-compute[72620]: DEBUG nova.virt.block_device [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating existing volume attachment record: 3d8c1cb1-5cc6-4d44-87a2-19bab73a0f2d {{(pid=72620) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 09 21:35:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:35:03 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Calling os-brick to attach iSCSI Volume {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaqjCDXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:35:07 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:35:07 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:35:07 user nova-compute[72620]: INFO os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d7e60-7d3e-4e93-8e83-bb2ec2771889]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 09 21:35:07 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --interface default --op new {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d98950-5809-4402-92d4-eac4dbe3085f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383] added\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383] added
Aug 09 21:35:07 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdea5fb-2f66-4ede-b5ae-c41c1368b75a]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[99292599-19f2-4a3b-a143-90e5e7210523]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaqjCDXK {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaqjCDXK" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[71947c2e-a589-41e5-939c-2b4b4ee06b72]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaqjCDXK'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b6b68-7102-4fac-87e6-d49ba9ebda7b]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:07 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7eb8dc0-b709-4d3b-acdc-c61de5fbe393]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:35:08 user nova-compute[72620]:  {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 09 21:35:08 user nova-compute[72620]:  {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:35:08 user nova-compute[72620]: WARNING os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 09 21:35:08 user nova-compute[72620]: 
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --login {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aab7e7-9b8d-4c83-bc0e-1078a68cca22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260]
Aug 09 21:35:08 user nova-compute[72620]: Login to [iface: default, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260] successful.
Aug 09 21:35:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a094f1-9fb2-4889-94ad-aab5a55973e3]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76efcd-0abf-4267-94fe-f75bc304a60d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)
Aug 09 21:35:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)
Aug 09 21:35:08 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to 172.16.0.220:3260 {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72620) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72620) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[015f7012-6a5e-4eb2-aea5-76267db377a2]: (4, ('- - 0', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72620) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 09 21:35:08 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaqjCDXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72620) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23335346562633366', 'path': '/dev/sdb'} {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335346562633366', 'path': '/dev/sdb'} {{(pid=72620) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.objects.instance [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] attach device xml: <disk type="block" device="disk">
Aug 09 21:35:09 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:35:09 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:35:09 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:35:09 user nova-compute[72620]:   <serial>b270a092-7667-474b-9127-c95f073b9383</serial>
Aug 09 21:35:09 user nova-compute[72620]: </disk>
Aug 09 21:35:09 user nova-compute[72620]:  {{(pid=72620) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vda, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72620) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] No VIF found with MAC fa:16:3e:83:02:42, not building metadata {{(pid=72620) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 09 21:35:09 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-be6e8485-d826-42ed-b359-4351e4617a29 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.951s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:35:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:35:12 user nova-compute[72620]: INFO nova.compute.manager [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Detaching volume b270a092-7667-474b-9127-c95f073b9383
Aug 09 21:35:12 user nova-compute[72620]: INFO nova.virt.block_device [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Attempting to driver detach volume b270a092-7667-474b-9127-c95f073b9383 from mountpoint /dev/vdb
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Attempting to detach device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config. {{(pid=72620) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:35:12 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:35:12 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:35:12 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:35:12 user nova-compute[72620]:   <serial>b270a092-7667-474b-9127-c95f073b9383</serial>
Aug 09 21:35:12 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:35:12 user nova-compute[72620]: </disk>
Aug 09 21:35:12 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:35:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the persistent domain config.
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config. {{(pid=72620) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.guest [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] detach device xml: <disk type="block" device="disk">
Aug 09 21:35:12 user nova-compute[72620]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 09 21:35:12 user nova-compute[72620]:   <source dev="/dev/sdb"/>
Aug 09 21:35:12 user nova-compute[72620]:   <target dev="vdb" bus="virtio"/>
Aug 09 21:35:12 user nova-compute[72620]:   <serial>b270a092-7667-474b-9127-c95f073b9383</serial>
Aug 09 21:35:12 user nova-compute[72620]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 09 21:35:12 user nova-compute[72620]: </disk>
Aug 09 21:35:12 user nova-compute[72620]:  {{(pid=72620) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-84515def-5265-45f2-b9a1-046441e0c9d2 None None] Received event <DeviceRemovedEvent: 1691616912.6111214, 53c63ea0-2151-4f46-9c10-b694bf1a866e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72620) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.driver [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 09 21:35:12 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully detached device vdb from instance 53c63ea0-2151-4f46-9c10-b694bf1a866e from the live domain config.
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] calling os-brick to detach iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4c502d8d90>, {'target_iqns': ['iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaqjCDXK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 09 21:35:12 user nova-compute[72620]: WARNING os_brick.initiator.connectors.base [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383', 0)] {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf89d026-e92e-4ea3-bf0a-c8e735305b8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e03c853-bdc6-47eb-ad69-4c10afd5898a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)
Aug 09 21:35:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 (non-flash)
Aug 09 21:35:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4c303e5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383'): ({'sdb'}, set())}) {{(pid=72620) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Removing single pathed devices sdb {{(pid=72620) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec364a6-1009-4d17-a316-06b5befd1ec4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb3e767-3926-4af3-ba99-9be2135688fa]: (4, ('ok\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Flushing IO for device /dev/sdb {{(pid=72620) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d069b-df32-4bf5-9cea-f42de785e467]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72620) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db19ec-9cd7-4486-94c0-cfc5b0aa8aa1]: (4, ('1', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.linuxscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] SCSI volumes sdb have been removed. {{(pid=72620) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383')] {{(pid=72620) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101eda0-c66b-4aff-97d8-66be2e417379]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --logout {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --logout" returned: 0 in 0.124s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62bbb14-83c0-4e10-bc2a-c71c07e966f6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260]
Aug 09 21:35:12 user nova-compute[72620]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383, portal: 172.16.0.220,3260] successful.
Aug 09 21:35:12 user nova-compute[72620]:  stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op delete {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b270a092-7667-474b-9127-c95f073b9383 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83828) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afcebaf-ebb0-4e30-92a4-7d5915f1cf97]: (4, ('', '')) {{(pid=83828) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72620) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.base [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG os_brick.initiator.connectors.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] <== disconnect_volume: return (341ms) None {{(pid=72620) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 09 21:35:12 user nova-compute[72620]: DEBUG nova.virt.libvirt.volume.iscsi [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Disconnected iSCSI Volume {{(pid=72620) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 09 21:35:13 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:13 user nova-compute[72620]: DEBUG nova.objects.instance [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'flavor' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:35:13 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-884eed4a-45b5-44ab-81c6-ed81b4d607ee tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:35:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:35:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:35:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:35:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:35:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:35:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:35:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:41 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:35:42 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.processutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72620) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 09 21:35:43 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:35:43 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.13829803466797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Instance 53c63ea0-2151-4f46-9c10-b694bf1a866e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72620) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:35:43 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:35:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:45 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:45 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:35:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:46 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:35:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:35:51 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:35:56 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:01 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:06 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:11 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:16 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:36:21 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:26 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:31 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:36:33 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquired lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Forcefully refreshing network info cache for instance {{(pid=72620) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 09 21:36:35 user nova-compute[72620]: DEBUG nova.objects.instance [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lazy-loading 'info_cache' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:36:36 user nova-compute[72620]: DEBUG nova.network.neutron [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [{"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:36:36 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Releasing lock "refresh_cache-53c63ea0-2151-4f46-9c10-b694bf1a866e" {{(pid=72620) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 09 21:36:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updated the network info_cache for instance {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 09 21:36:36 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:39 user nova-compute[72620]: INFO nova.compute.manager [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Terminating instance
Aug 09 21:36:39 user nova-compute[72620]: DEBUG nova.compute.manager [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Start destroying the instance on the hypervisor. {{(pid=72620) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-unplugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] No waiting events found dispatching network-vif-unplugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG nova.compute.manager [req-4d1e0647-3d50-487b-9979-b0de7bc6d2e6 req-fe66a534-7de0-4cae-8265-c9b21b98cbfe service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-unplugged-bad9968b-89d3-430d-bfc8-5472536e31c9 for instance with task_state deleting. {{(pid=72620) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 09 21:36:39 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:39 user nova-compute[72620]: INFO nova.virt.libvirt.driver [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Instance destroyed successfully.
Aug 09 21:36:39 user nova-compute[72620]: DEBUG nova.objects.instance [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lazy-loading 'resources' on Instance uuid 53c63ea0-2151-4f46-9c10-b694bf1a866e {{(pid=72620) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG nova.virt.libvirt.vif [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-09T21:29:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1429553455',display_name='tempest-SnapshotDataIntegrityTests-server-1429553455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1429553455',id=52,image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+GX+48juroGPnkEmXlOOCq7ykXakm7TWkkqJke4yNdYJcDvja8bkdMDdg03yD1bYCzRVVhbNhgpJu39+4mMQJn95gGp9vKd5qdnTF65sygW32QBR/QwRIN+IhEpcy/cw==',key_name='tempest-keypair-746717892',keypairs=<?>,launch_index=0,launched_at=2023-08-09T21:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8aa0a8be5e4046d39ace27d31bac920d',ramdisk_id='',reservation_id='r-s6o4dk00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5cbb687-0055-4eb1-92d5-736844e9b958',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-535145560',owner_user_name='tempest-SnapshotDataIntegrityTests-535145560-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-09T21:29:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4bd5461818f4ad3b6a2e95e6e517d99',uuid=53c63ea0-2151-4f46-9c10-b694bf1a866e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converting VIF {"id": "bad9968b-89d3-430d-bfc8-5472536e31c9", "address": "fa:16:3e:83:02:42", "network": {"id": "a653b858-dfc9-4ebc-805d-285b8b3ae27d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1751673115-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8aa0a8be5e4046d39ace27d31bac920d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad9968b-89", "ovs_interfaceid": "bad9968b-89d3-430d-bfc8-5472536e31c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG nova.network.os_vif_util [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89') {{(pid=72620) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG os_vif [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89') {{(pid=72620) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad9968b-89, bridge=br-int, if_exists=True) {{(pid=72620) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:36:40 user nova-compute[72620]: INFO os_vif [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:02:42,bridge_name='br-int',has_traffic_filtering=True,id=bad9968b-89d3-430d-bfc8-5472536e31c9,network=Network(a653b858-dfc9-4ebc-805d-285b8b3ae27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad9968b-89')
Aug 09 21:36:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Deleting instance files /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e_del
Aug 09 21:36:40 user nova-compute[72620]: INFO nova.virt.libvirt.driver [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Deletion of /opt/stack/data/nova/instances/53c63ea0-2151-4f46-9c10-b694bf1a866e_del complete
Aug 09 21:36:40 user nova-compute[72620]: INFO nova.compute.manager [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 09 21:36:40 user nova-compute[72620]: DEBUG oslo.service.loopingcall [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72620) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG nova.compute.manager [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Deallocating network for instance {{(pid=72620) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 09 21:36:40 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] deallocate_for_instance() {{(pid=72620) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.network.neutron [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Updating instance_info_cache with network_info: [] {{(pid=72620) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 09 21:36:41 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Took 1.00 seconds to deallocate network for instance.
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:41 user nova-compute[72620]: INFO nova.scheduler.client.report [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Deleted allocations for instance 53c63ea0-2151-4f46-9c10-b694bf1a866e
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-33da360f-5d8d-4dd1-b205-164cc16299d3 tempest-SnapshotDataIntegrityTests-535145560 tempest-SnapshotDataIntegrityTests-535145560-project-member] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] Acquiring lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] Lock "53c63ea0-2151-4f46-9c10-b694bf1a866e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] No waiting events found dispatching network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 09 21:36:41 user nova-compute[72620]: WARNING nova.compute.manager [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received unexpected event network-vif-plugged-bad9968b-89d3-430d-bfc8-5472536e31c9 for instance with vm_state deleted and task_state None.
Aug 09 21:36:41 user nova-compute[72620]: DEBUG nova.compute.manager [req-f0d968b0-74f8-4e91-9d00-c5fad361215a req-6249150e-a554-4358-8ac0-2196fb903944 service nova] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Received event network-vif-deleted-bad9968b-89d3-430d-bfc8-5472536e31c9 {{(pid=72620) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 09 21:36:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:44 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:36:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=25.165348052978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:36:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:36:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:46 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:46 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:36:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:36:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:54 user nova-compute[72620]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1691616999.9939277, 53c63ea0-2151-4f46-9c10-b694bf1a866e => Stopped> {{(pid=72620) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 09 21:36:54 user nova-compute[72620]: INFO nova.compute.manager [-] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] VM Stopped (Lifecycle Event)
Aug 09 21:36:55 user nova-compute[72620]: DEBUG nova.compute.manager [None req-ee4cdcd6-c17a-4ca0-882e-8c2014af0c10 None None] [instance: 53c63ea0-2151-4f46-9c10-b694bf1a866e] Checking state {{(pid=72620) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:36:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:05 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:37:10 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:37:15 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:37:20 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:25 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:30 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:34 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:35 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:35 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:36 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Starting heal instance info cache {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 09 21:37:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Rebuilding the list of instances to heal {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 09 21:37:36 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Didn't find any instances for network info cache update. {{(pid=72620) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 09 21:37:37 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:38 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:40 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:40 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:44 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:37:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:37:44 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:37:44 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Auditing locally available compute resources for user (node: user) {{(pid=72620) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 09 21:37:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:37:45 user nova-compute[72620]: WARNING nova.virt.libvirt.driver [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Hypervisor/Node resource view: name=user free_ram=9047MB free_disk=25.164142608642578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72620) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72620) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72620) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72620) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.compute.provider_tree [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed in ProviderTree for provider: bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 {{(pid=72620) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.scheduler.client.report [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Inventory has not changed for provider bf3cd726-0758-4dff-9e6c-ef2d0988f3d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72620) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG nova.compute.resource_tracker [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Compute_service record updated for user:user {{(pid=72620) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 09 21:37:45 user nova-compute[72620]: DEBUG oslo_concurrency.lockutils [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=72620) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 09 21:37:47 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:48 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:48 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72620) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 09 21:37:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:49 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:50 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:50 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:51 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:55 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 09 21:37:59 user nova-compute[72620]: DEBUG oslo_service.periodic_task [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72620) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 09 21:37:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] Cleaning up deleted instances {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 09 21:37:59 user nova-compute[72620]: DEBUG nova.compute.manager [None req-2e5ce4db-d288-471a-8007-a34751a9a825 None None] There are 0 instances to clean {{(pid=72620) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 09 21:38:00 user nova-compute[72620]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72620) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}